-- Logs begin at Mon 2022-06-06 20:13:14 UTC, end at Mon 2022-06-06 21:22:56 UTC. -- Jun 06 20:48:46.247204 dv-cinder-844880-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 06 20:48:46.254967 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 20:48:46 2022] *** Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: nodename: dv-cinder-844880-1-iscsi Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: machine: x86_64 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: clock source: unix Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: pcre jit disabled Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: detected number of CPU cores: 4 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: current working directory: / Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: detected binary path: /usr/bin/uwsgi-core Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: your processes number limit is 47680 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: your memory page size is 4096 bytes Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: detected max file descriptor number: 2048 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: lock engine: pthread robust mutexes Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: thunder lock: enabled Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 06 20:48:46.260021 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 20:48:46.303018 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: Python main interpreter initialized at 0x556abdfbd9c0 Jun 06 20:48:46.303018 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: python threads support enabled Jun 06 20:48:46.303018 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: your server socket listen backlog is limited to 100 connections Jun 06 20:48:46.303018 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: your mercy for graceful operations on workers is 90 seconds Jun 06 20:48:46.303457 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 20:48:46.303457 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: *** Operational MODE: preforking *** Jun 06 20:48:46.303669 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: *** uWSGI is running in multiple interpreter mode *** Jun 06 20:48:46.303669 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: spawned uWSGI master process (pid: 80303) Jun 06 20:48:46.303871 dv-cinder-844880-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 06 20:48:46.305139 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: spawned uWSGI worker 1 (pid: 80313, cores: 1) Jun 06 20:48:46.305139 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: spawned uWSGI worker 2 (pid: 80314, cores: 1) Jun 06 20:48:46.305139 dv-cinder-844880-1-iscsi devstack@keystone.service[80303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 20:48:52.119622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:48:52.119622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: from cryptography.utils import int_from_bytes Jun 06 20:48:52.120806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:48:52.120806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: from cryptography.utils import int_from_bytes Jun 06 20:48:52.170724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:48:52.171007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:48:52.171141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] command line args: [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:48:52.171339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:48:52.171519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ================================================================================ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:48:52.171783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] admin_token = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.172055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] config_dir = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.172225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.172415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] config_source = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.172598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] debug = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.172808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.173211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.173377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.173609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.173857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_config_append = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_dir = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.174981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.175230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.175477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.175724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.175914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.176117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.176330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.176613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.176895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.177192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.177428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.177663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.177918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.178165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.178444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.178955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.179133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] publish_errors = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.179356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.179619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.179808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.179985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.180216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.180459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] standard_threads = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.180691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.180939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.181136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.181314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] use_journal = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.181489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] use_json = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.181669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] use_stderr = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.181844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] use_syslog = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.182042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.182231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.182454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.182716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.182958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.183210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.183461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.183753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.183979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.184201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.184450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.184706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.184939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.185188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.185382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.185634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.185885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.186122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.186379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.186637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.186884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.187123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.187381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.187646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.187900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.188178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.188410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.188642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.188864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.189098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.189334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.189587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.189819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.190049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.190296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.190577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.190767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.191009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.191244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.191483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.191719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.191942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.192392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.192588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.192793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.193034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.193458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.193695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.193938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.194171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.194403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.194633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.194886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.195118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.195359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.195596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.195832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.196102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.196342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.196574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.196827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.197062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.197304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.197537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.197798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.198279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.198482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.198719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.198994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.199232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.199496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.199745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.199981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.200252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.200488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.200984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.201224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.201468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.201704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.201944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.202192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.202429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.202670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.202940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.203183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.203424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.203663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.203906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.204152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.204398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.204633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.204869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.205083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.205317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.205553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.205794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.206036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.206274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.206524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.206760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.207018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.207279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.207521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.207754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.external = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.208100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.208472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.208709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.208942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.password = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.209173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.token = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.209418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.209728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.209914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.210097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.210334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.210588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.210818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.211055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.211302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.211555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.211804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.212058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.212302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.212540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.212808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.213063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.213302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.213559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.213852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.214100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.214367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.214612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.214870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.215108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.215354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.215600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.215851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.216456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.216711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.216949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.217209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.217451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.217710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.217947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.218196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.218433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.218685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.218932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.219170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.219407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.221441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.221720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.221968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.222239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.222510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.222758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.223002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.223257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.223510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.223775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.224059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.224330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.224585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.224976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.225225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.225472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.225710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.225956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.226192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.226436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.226691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.226937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.227197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.227439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.227693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.227948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.228235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.228490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.228743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.228977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.229222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.229455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.229697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.229939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.230192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.230437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.230677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.230936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.231190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.231426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.231663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.231916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.232182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.232427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.232667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.232907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.233143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.233391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.233659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.233895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.234146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.234395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.234644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.234884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.235119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.235371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.235611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.235854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.236106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.236363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.236614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.236866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.237115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.237362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.237592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.237846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.238088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.238327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.238568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.238891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.239105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.239493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.239870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.240166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.240418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.240674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.240916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.241157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.241401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.241653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.241898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.242134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.242376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.242620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.242873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.243127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.243366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.243618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.243874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.244144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.244396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.244636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.244880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.245119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] role.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.245369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] role.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.245601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.245854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.246106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.246353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.246604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.246853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.247100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.247354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.247605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.247843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.248120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.248372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.248623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.248875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.249327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.249564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.249818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.250068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.250327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.250581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.250822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.251085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.251344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.251575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.251808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.252077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.252276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.252536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.252792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.253044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.253284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.253526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.253758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.253997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.254234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.254482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.254795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.255098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.255350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.255591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.255836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.256112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.256364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.256601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.256845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.257080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.257330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.257583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.257816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.258062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.258373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.258639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.258942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.259143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.259362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.259605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.259839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.260104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.260351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.260589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.260839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.261079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.261326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.261565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.261816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.262054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.262302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.262535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.262776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.263013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.263204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:48:52.293072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.293325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.293532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.302558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.305228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:48:52.305228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: from cryptography.utils import int_from_bytes Jun 06 20:48:52.306128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:48:52.306128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: from cryptography.utils import int_from_bytes Jun 06 20:48:52.340665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.340951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.355687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:48:52.355937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:48:52.356104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] command line args: [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:48:52.356333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:48:52.356517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ================================================================================ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:48:52.356775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] admin_token = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.357019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] config_dir = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.357206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.357390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] config_source = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.357565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] debug = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.357779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.358013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.358167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.358435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.358683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.358907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.359156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_config_append = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.359350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.359540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_dir = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.359734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.359914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.360125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.360323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.360506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.360686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.360869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.361064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.361308 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.361543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.361773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.362006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.362236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.362484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.362725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.363002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.363507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.363708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] publish_errors = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.363914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.364198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.364431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.364875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.365211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.365450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] standard_threads = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.365662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.365917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.366114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.366302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] use_journal = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.366473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] use_json = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.366649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] use_stderr = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.366841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] use_syslog = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.367030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:48:52.367221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.367406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.367669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.367910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.368185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.368424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.368669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.368908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.369170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.369402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.369654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.369889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.370135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.370372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.370618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.370867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.371104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.371360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.371613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.371861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.372120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.372376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.372640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.372890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.373139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.373371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.373602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.373835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.374073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.374325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.374573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.374803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.375035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.375281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.375527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.375765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.376067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.376261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.376493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.376732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.376959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.377190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.377426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.377665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.377903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.378153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.378385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.378620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.378850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.379086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.379323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.379571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.379950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.380330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.380760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.381126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.381370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.381612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.381846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.382098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.382337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.382579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.382817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.383080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.383320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.383554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.383794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.384060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.384314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.384555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.384807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.385056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.385291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.385527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.385762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.386009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.386246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.386483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.386725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.386963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.387201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.387436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.387674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.387910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.388202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.388443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.388685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.388900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.389151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.389387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.389624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.389865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.390094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.390330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.390562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.390797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.391026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.391268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.391501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.391747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.391984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.392265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.392523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.392777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.393011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.external = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.393232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.393534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.393766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.393998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.password = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.394228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.token = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.394515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.394717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.394938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.395168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.395552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.395940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.396218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.396409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.396603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.396787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.396967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.397211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.397508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.397698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.397909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.398173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.398427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.398662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.398915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.399202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.399451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.399713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.399955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.400235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.400472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.400708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.400954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.401200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.401428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.401676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.401912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.402166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.402401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.402656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.402892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.403139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.403374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.403622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.403869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.404122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.404361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.406266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.406505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.406775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.407047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.407319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.407565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.407811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.408074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.408319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.408578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.408833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.409347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.409624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.409867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.410111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.410347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.410592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.410827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.411205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.411566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.412020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.412397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.412639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.412895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.413150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.413395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.413648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.413897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.414132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.414375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.414606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.414850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.415091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.415341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.415578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.415819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.416084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.416330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.416565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.416799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.417053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.417303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.417542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.417782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.418021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.418255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.418499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.418763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.427611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.428261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.428535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.428806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.429060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.429362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.429745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.430124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.430503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.430865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.431255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.431637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.432039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.432432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.432815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.433179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.433565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.433938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.434311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.434677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.435046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.435426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.435807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.436214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.436608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.436967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.437347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.437716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.438083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.438454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.438839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.439217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.439580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.439954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.440358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.440747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.441132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.441433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.441728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.442117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.442544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.442931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.443339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.443670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.444064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] role.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.444451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] role.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.444811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.445202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.445590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.445985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.446298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.446688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.447012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.447156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.447264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.447429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.447594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.447771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.447947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.448334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.448593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.448850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.449418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.449792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.450178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.450564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.450948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.451334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.451693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.452120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.452503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.452910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.453321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.453564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.453805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.454064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.454372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.454629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.454873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.455101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.455402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.455779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.456184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.456562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.456933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.457323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.457699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.458072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.458447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.458854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.459293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.459630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.459879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.460145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.460403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.460702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.460940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.461185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.461500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.461910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.462292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.462673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.463041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.463411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.463773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.464169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.464533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.464904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.465323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.465729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.465984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.466556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.466807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.467093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.467344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.467580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.467822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.468150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:48:52.468421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:48:52.496492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.496742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.496926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.505902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.517823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.518046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.518263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.518487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.518708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.518930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.525308 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.525530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.543056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.543301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.543500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.543716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.543935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.544190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.544412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.556829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.566790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.570451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.570693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.570880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.571101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.571323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.571539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.571751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.589682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.589936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 20:48:52.590211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.590411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 20:48:52.590679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.590936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.591538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.591797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.603130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.603419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.603693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.604214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.605509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.605743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.612732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.616690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.616988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.617275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.617554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.617834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.618094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.618359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.618629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.618896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.619164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.619552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.647509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.649252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.649533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.654149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.654387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.654610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.654831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.655052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.655198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.655330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.655471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.655598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.663443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.663737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.668382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.668674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.668958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.669241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.669387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.669522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.669645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.669782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.669911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.670037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.670164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.670289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.670429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.670549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.670672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.679715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.683200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.683474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.683608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.683854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.684072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.684274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.684487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 20:48:52.689999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.690302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.695553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.696305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.696521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 20:48:52.696867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.697258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 20:48:52.697562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.697824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.698084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.698348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.699557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.699878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.705350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.709352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.710629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.710930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.711198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.711480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.713382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.713704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.713989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.714275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.714562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.714986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.720839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.725281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.725632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.726052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.726480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.726895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.727275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.727673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.728116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.728529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.728929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.729372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.735760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.736091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.736362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.736625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.746864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.748780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.749064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.752247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.752623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.752825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.753118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.753401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.767371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.767630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.767781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.767921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.768240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.768521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.768795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.769069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.769206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.769457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.775522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.775948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.776260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.783730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.784045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.787453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.789437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.789736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.790019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.790308 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.790578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.790870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.791025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.791219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.791378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.794403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.796037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.797712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.797993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.798271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.806266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.808161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.811365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.811656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.811936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.812157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.812342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.812483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.817256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.821709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.821928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.822088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.822243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.822384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.827228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.830382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.830673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.830824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.830958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.831223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.831494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.831772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.833403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.833403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.833403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.833403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.833403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.834827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.835111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.835259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.835393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.835540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.835739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.836043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.836326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.836610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.856725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.857023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.857301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.857571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.866351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.868178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.868458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.873185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.873467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.873746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.874030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.874337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.874484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556abdfbd9c0 pid: 80314 (default app) Jun 06 20:48:52.877813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e491-197b-4f88-bc5f-5abce155e927 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:48:52.878104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e491-197b-4f88-bc5f-5abce155e927 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:48:52.878385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e491-197b-4f88-bc5f-5abce155e927 None None] PATH_INFO: `/v3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:48:52.882882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Mon Jun 6 20:48:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:48:52.888466 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.888764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.889056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.889458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.890015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.890015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.890282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.909034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.912885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.916320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.918090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.919745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.920050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.920333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.928502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.930279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.933758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.934078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.934359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.934636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.944475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.944788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.945076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.953167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 20:48:52.953468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.953886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.954196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.954439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.954758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.955036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.955279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.955584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.955853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.956126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.956406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.956631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.956908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 20:48:52.997503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556abdfbd9c0 pid: 80313 (default app) Jun 06 20:49:01.169393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:01.169978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:01.169978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:01.171335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:01.179495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:01.180162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:01.180162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:01.248062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: INFO dbcounter [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] Registered counter for database keystone Jun 06 20:49:01.269873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG oslo_db.sqlalchemy.engines [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:49:01.279265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writer thread running {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:49:01.587461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG passlib.handlers.bcrypt [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80313) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 20:49:01.587891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG passlib.handlers.bcrypt [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80313) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 20:49:01.645490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:01.647230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:01.783671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 06 20:49:01.821227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:01.891826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: INFO dbcounter [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] Registered counter for database keystone Jun 06 20:49:01.913479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:49:01.921139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writer thread running {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:49:02.153329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6649-0fc9-45ec-a138-2e26e7864221 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:02.157830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:02.158524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:02.158835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:02.159088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:02.168594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:02.220671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING keystone.common.rbac_enforcer.enforcer [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 20:49:02.221417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30700-5c61-49ac-b942-9586ad73454c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:02.232556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Jun 6 20:49:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 20:49:02.239702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:02.255953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b6933-f729-4b6c-b83b-d3742fb4f169 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:02.261719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:02.263548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:02.264007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:02.264457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] PATH_INFO: `/v3/projects/975471a492db48b49b1c3d1741da2fcb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:02.267063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=975471a492db48b49b1c3d1741da2fcb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:02.346415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 20:49:02.346834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5897a15-1287-4389-bf18-35687d4305b9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:02.353751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 2/5] 10.222.0.33 () {56 vars in 1207 bytes} [Mon Jun 6 20:49:02 2022] GET /identity/v3/projects/975471a492db48b49b1c3d1741da2fcb => generated 344 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:04.700548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee02c8-25df-4f5d-a5d8-74edeeed6d34 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:04.701213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee02c8-25df-4f5d-a5d8-74edeeed6d34 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:04.701213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee02c8-25df-4f5d-a5d8-74edeeed6d34 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:04.705238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 4/6] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:04.711355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:04.711848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:04.711953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:04.735120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:04.736702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:04.745277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 06 20:49:04.768751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee02c8-25df-4f5d-a5d8-74edeeed6d34 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:04.782220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee02c8-25df-4f5d-a5d8-74edeeed6d34 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:04.786581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:04.787237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:04.787520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:04.787793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:04.796402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:04.798217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc25bee-41ca-41a8-b866-eed6747d3d62 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:04.807633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Jun 6 20:49:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 20:49:04.813863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:04.823554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7f89c-42cc-4b62-a510-0bbff3ed1578 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:04.828295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:04.829192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:04.829477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:04.829756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:04.831178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:04.833149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebf852-f115-44ac-9bfe-9949b8608b7f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:04.834761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 4/9] 10.222.0.33 () {56 vars in 1198 bytes} [Mon Jun 6 20:49:04 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:07.255966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a698-1e36-419e-a6b6-aa0764d97409 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.256807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a698-1e36-419e-a6b6-aa0764d97409 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.256807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a698-1e36-419e-a6b6-aa0764d97409 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.258418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:07.264277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.265072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.265072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.283608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:07.284982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:07.290735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863a49-4181-41d9-9d61-bdbcf912e5e3 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.291218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863a49-4181-41d9-9d61-bdbcf912e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.291692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863a49-4181-41d9-9d61-bdbcf912e5e3 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.294050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 7/11] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:07.299776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.300186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.300904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.343442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG passlib.handlers.bcrypt [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80314) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 20:49:07.343778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG passlib.handlers.bcrypt [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80314) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 20:49:07.390219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:07.391917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:07.399704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 5/12] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:07.424630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:07.455234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:07.517211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 8/13] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:07.540098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:07.564756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc322f22-61a6-4127-8b03-300af7dca299 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:07.615108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:07.616201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.616583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.616943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.632132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:07.644338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:07.646219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:07.647669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 6/14] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:07.654186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:07.682580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70400606-bbe1-4835-95d2-79d44f2b912f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:07.686825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:07.737207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:07.738646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.739152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.739621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.776581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:07.799364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8cf-8824-461c-a8c5-a7a51e684a99 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:07.830774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:07.832655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:07.843010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:07.844082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:07.844530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:07.844972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:07.846090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:07.846550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:07.849489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:07.865705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 7/15] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:07.871954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:07.954477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:07.960824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:07.964149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:07.987482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68623fd-246c-4f3c-8ba3-33fe64fcf848 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:08.028884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:08.029888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:08.030294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:08.030675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:08.032218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:08.033881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:08.035799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 8/17] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:07 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:08.043040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:08.067732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:08.086156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039076f-644d-4715-86b8-06d0cca77fb3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:08.134444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:08.135214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:08.135588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:08.135941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:08.158607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:08.160747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:49:08.185166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:08.186770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:08.187963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:49:08.187963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:49:08.187963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:49:08.187963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:08.188238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaceea-14b5-4e59-b2a6-46f2909afbad None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:08.188321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:08.195368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:08.240510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:08.241670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:08.242123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:08.242558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:08.244582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:08.247008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:08.249872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:08.259351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:08.285473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:08.342080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a515076-1c60-4567-9ce6-f809921a1e10 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:08.363218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:08.384417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:08.385326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:08.385716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:08.386089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:08.387162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:08.387563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:08.389403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162072-e80f-4b9d-aab7-66a625063fe4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:08.390200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e66c4-59ef-4161-9eec-a8913587930b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:08.413119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:08.436068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:08.436790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:08.437071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:08.437346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:08.438224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.domain.id=default, user.id=d45573389f8249aaa5d35d830a5a6625) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:08.438530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:08.440136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3d17e-6551-4e25-b6bc-5a6ae4d1a908 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:08.449643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Jun 6 20:49:08 2022] GET /identity/v3/role_assignments?user.id=d45573389f8249aaa5d35d830a5a6625&scope.domain.id=default&role.id=752ec01362414518a74fb7fe863f812e => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:12.464941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ceab-9466-47fb-bdc4-0521ba7145e0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.465668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ceab-9466-47fb-bdc4-0521ba7145e0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.465668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ceab-9466-47fb-bdc4-0521ba7145e0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.467422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:12.474104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbc6e-8584-448f-a4ec-9c19fd93d9df None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.474866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbc6e-8584-448f-a4ec-9c19fd93d9df None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.474866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdbc6e-8584-448f-a4ec-9c19fd93d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.510507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-eabdbc6e-8584-448f-a4ec-9c19fd93d9df None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:12.512842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eabdbc6e-8584-448f-a4ec-9c19fd93d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:12.612550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b8cf-f832-46e9-a951-2cda12f60e43 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.612967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b8cf-f832-46e9-a951-2cda12f60e43 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.613115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b8cf-f832-46e9-a951-2cda12f60e43 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.614635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:12.635620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.635885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.636227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.664677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:12.665902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:12.677020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:12.711984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3df12-66c2-484c-aaf0-6081d8c31bbb None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.712404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3df12-66c2-484c-aaf0-6081d8c31bbb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.712545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3df12-66c2-484c-aaf0-6081d8c31bbb None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.713938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 12/25] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:12.722681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa2c1-4545-4130-8500-a5324788c4fc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.722961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa2c1-4545-4130-8500-a5324788c4fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.723287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa2c1-4545-4130-8500-a5324788c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.753301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-68faa2c1-4545-4130-8500-a5324788c4fc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:12.754745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-68faa2c1-4545-4130-8500-a5324788c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:12.811742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 14/26] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:12.812887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:12.881429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 13/27] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 06 20:49:12.882888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c747-e261-4c42-835a-5cc967e1979c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:12.883177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c747-e261-4c42-835a-5cc967e1979c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:12.883454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c747-e261-4c42-835a-5cc967e1979c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:12.889672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 14/28] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:12.901663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c747-e261-4c42-835a-5cc967e1979c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:12.913251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:12.917471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:13.060334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c747-e261-4c42-835a-5cc967e1979c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:13.069178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23b0bd-8c40-4325-8866-1d31b7041489 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:13.109877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:13.110577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:13.110862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:13.111137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:13.111912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:13.113400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:13.147266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:13.148044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:13.148335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:13.148607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:13.149388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:13.150906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c9b0d-990f-406a-97d7-519e4753ba75 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:13.244873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 15/29] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 6 20:49:12 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:13.246092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:13.299446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 15/30] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 6 20:49:12 2022] POST /identity/v3/roles => generated 225 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:13.299446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:13.299446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:13.299446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:13.320508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:13.323079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:13.435814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:13.460352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:13.502155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:13.554626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578d109-7b6f-45aa-bab3-b1307a867d4e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:13.615749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:13.648905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:13.649760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:13.650050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:13.650332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:13.669447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:13.671220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:49:13.701527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:13.702492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:13.703770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:49:13.703770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:49:13.703770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:49:13.703770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:13.703770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 16/32] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:13.724122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:13.765594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104ba2a-b0dc-4a94-b332-dafb65b4ce4d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:13.832866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:13.834122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:13.834549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:13.834976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:13.858539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:13.876076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:13.878185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:13.881265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 17/33] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:13.893760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:13.945192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ef45-bd8a-4955-b3d7-8fabc74477f5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:13.995746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.047072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.048326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.048829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.049323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.050700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:14.051757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.054545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.065028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.080369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663afa6-df71-487e-8831-f3eb2708037e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.112069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 17/34] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:14.121893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.130899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.131683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.132117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.140148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.140148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:14.140148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.140148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.152534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 18/35] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:14.163781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.329310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ac8e-10f6-456e-82ac-de45d36b2c54 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.381773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd24ee-5fa1-4b70-96aa-fff342275600 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.399208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.400307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.401436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.401910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.403170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.406648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1e587-0286-4f92-acf6-5cd887ef6554 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.444816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.446078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.447908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.447908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.449882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.452240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.460368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 19/36] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:14 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:14.463822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.475021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:49:14 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:49:14.480034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328ba0-1ad5-4041-a650-00cebe8b320c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.480034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328ba0-1ad5-4041-a650-00cebe8b320c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.480034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328ba0-1ad5-4041-a650-00cebe8b320c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.482323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 19/38] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:14.490810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec629-25f7-4f89-ae12-883a451acd20 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.491264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec629-25f7-4f89-ae12-883a451acd20 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.491690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec629-25f7-4f89-ae12-883a451acd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.519474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b25ec629-25f7-4f89-ae12-883a451acd20 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:14.522811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b25ec629-25f7-4f89-ae12-883a451acd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:14.530942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.565568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.643444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:14.645683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b871f6-4d97-4033-8e41-1a7bb9bdbe52 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.646174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b871f6-4d97-4033-8e41-1a7bb9bdbe52 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.646676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b871f6-4d97-4033-8e41-1a7bb9bdbe52 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.653952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 21/40] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:14.656184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.656509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.656755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.673387 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea8f82-90e2-45a5-85f3-e9f5c4b44c5b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.684261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:14.686204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:14.714643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.715473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.715765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.716432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.717680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.719183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.721297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 20/41] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:14.722070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.802388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:14.808053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.891443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.903189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196645-4a6a-4c37-9f02-8f40ebda1bdf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.911290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:14.927401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5d41-8585-4665-bd10-d7cd29fee8e9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:14.948710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.949651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.949998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.950348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.951254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.952794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:14.971126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 21/43] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 6 20:49:14 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:14.972213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:14.988608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:14.989708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:14.990010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:14.990295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] PATH_INFO: `/v3/domains/default/users/d45573389f8249aaa5d35d830a5a6625/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:14.992808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d45573389f8249aaa5d35d830a5a6625, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:14.994369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:15.014569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 23/44] 10.222.0.33 () {58 vars in 1361 bytes} [Mon Jun 6 20:49:14 2022] PUT /identity/v3/domains/default/users/d45573389f8249aaa5d35d830a5a6625/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:15.137291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b208d8f-db98-4d32-8f0b-705dc85d4128 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:15.182459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:15.183200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:15.183516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:15.183798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:15.185293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:15.186909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c80e21-8533-4920-a37f-70364fc565b3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:15.189151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 22/45] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:15.195306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:15.362693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d403c-3d62-4053-8787-d3fa74c3d243 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:15.411680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:15.412877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:15.413371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:15.413862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:15.415116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:15.417938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4338778-8781-42ca-ac6a-667a236f8ea4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:15.455455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:15.468534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:49:15 2022] POST /identity/v3/projects => generated 312 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:49:17.369762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26f64-c540-4fd5-9200-b31b95e8d191 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:17.370520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26f64-c540-4fd5-9200-b31b95e8d191 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:17.370520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26f64-c540-4fd5-9200-b31b95e8d191 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:17.371779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 23/47] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:17.378081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:17.378882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:17.379027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:17.398725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:17.399942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:17.474583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:17.498916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26f64-c540-4fd5-9200-b31b95e8d191 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:17.544872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:17.687348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26f64-c540-4fd5-9200-b31b95e8d191 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:17.729997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:17.730818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:17.731099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:17.731374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:17.744680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:17.752868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:17.754714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:17.756508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 24/49] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:17.762495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:17.882603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f172b-c769-495f-9e62-988bc441d5a8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:17.916151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:17.923898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:17.924786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:17.925167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:17.925546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:17.926636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:17.927118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:17.928693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:17.939291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 26/50] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:17.945640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:18.054119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:18.077570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a96b-6cb8-4fa7-ad40-707e6b1dfcfb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:18.118055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:18.118962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.119248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.119527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.120864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:18.122392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe522a-c22c-4951-977d-830179c6375f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:18.124589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 25/51] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:17 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:18.130889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:18.257697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d64b-af1f-4dec-a4b2-3815512127a5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.257968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d64b-af1f-4dec-a4b2-3815512127a5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.258405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d64b-af1f-4dec-a4b2-3815512127a5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.260341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 26/52] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:18.266710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.267169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.267569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.292143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:18.294004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:18.305534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5d2d5-4f56-4ddb-8855-8c0bee02de59 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:18.344848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:18.345664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.345944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.346220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.347485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:18.349554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:18.351258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:18.360382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:18.381391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 27/54] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:18.424458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:18.425167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:18.473957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe8ef-bbb4-419f-b342-17297a307ff7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:18.538228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:18.540911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:18.542066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.542566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.543104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.544743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.domain.id=default, user.id=d45573389f8249aaa5d35d830a5a6625) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:18.545278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:18.548169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:18.559954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Jun 6 20:49:18 2022] GET /identity/v3/role_assignments?user.id=d45573389f8249aaa5d35d830a5a6625&scope.domain.id=default&role.id=752ec01362414518a74fb7fe863f812e => generated 530 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:18.561216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865db10c-ba24-4782-9607-ca77522a12a2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:18.635953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:18.637410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.637914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.638405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.640841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:18.643599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca22e-e5ba-4976-95ba-0d8731b44cae None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:18.646907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 28/56] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:18.655842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:18.786555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787760-111d-4556-ac06-b22dfff16166 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:18.824208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:18.836350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:18.837042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:18.837332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:18.837616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:18.838346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:18.839842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d6a9-c224-4d1c-a162-42b7e0aea2eb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:18.874034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 29/57] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Jun 6 20:49:18 2022] POST /identity/v3/projects => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:21.251729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf92d-60ac-44a3-87b3-bbe6e900afdf None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:21.252423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf92d-60ac-44a3-87b3-bbe6e900afdf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:21.252423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf92d-60ac-44a3-87b3-bbe6e900afdf None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:21.254036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 29/58] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:21.262046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:21.262623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:21.262995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:21.292454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:21.294370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:21.413982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:21.440545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf92d-60ac-44a3-87b3-bbe6e900afdf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:21.564723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf92d-60ac-44a3-87b3-bbe6e900afdf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:21.605483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:21.606311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:21.606596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:21.606871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:21.608189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:21.609679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc1c39-c43f-430d-92ff-7385f9fbf6b5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:21.611408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 30/60] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:21.620150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:21.756452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4a7b-8c15-4f8a-a811-3bba186b0684 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:21.765226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:21.796203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:21.796908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:21.797190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:21.797464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:21.798192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:21.799676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e46069-c6d8-4587-8e13-0a65ff9b691a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:21.829264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 31/61] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:21 2022] POST /identity/v3/users => generated 275 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:25.964028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaddf7-8ea6-4a92-90bd-b39c740e01cd None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:25.965125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaddf7-8ea6-4a92-90bd-b39c740e01cd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:25.965615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaddf7-8ea6-4a92-90bd-b39c740e01cd None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:25.967615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 31/62] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:25.974025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73717-e977-468c-91ea-fe71dd75449f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:25.975085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73717-e977-468c-91ea-fe71dd75449f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:25.975577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73717-e977-468c-91ea-fe71dd75449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.000503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-79d73717-e977-468c-91ea-fe71dd75449f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:26.002211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-79d73717-e977-468c-91ea-fe71dd75449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:26.108189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:26.142618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaddf7-8ea6-4a92-90bd-b39c740e01cd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.167283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:26.297626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaddf7-8ea6-4a92-90bd-b39c740e01cd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:26.345765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157603-82c3-495c-8d08-89dc8af3ac20 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.346333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157603-82c3-495c-8d08-89dc8af3ac20 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.346794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d157603-82c3-495c-8d08-89dc8af3ac20 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.348595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 33/64] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:26.352041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:26.352041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.352041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.352041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.355389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ec6d-25b4-4d73-83fa-55ffa0ee5098 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.355886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ec6d-25b4-4d73-83fa-55ffa0ee5098 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.356399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4ec6d-25b4-4d73-83fa-55ffa0ee5098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.364751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:26.372927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:26.374104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:26.375051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:26.377641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 32/65] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:26.385402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.402293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-90e4ec6d-25b4-4d73-83fa-55ffa0ee5098 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:26.403889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-90e4ec6d-25b4-4d73-83fa-55ffa0ee5098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:26.524726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:26.539866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 34/66] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:26.541701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458a4-bf14-43b5-bc51-fcf1f365cead None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.542244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458a4-bf14-43b5-bc51-fcf1f365cead None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.542710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458a4-bf14-43b5-bc51-fcf1f365cead None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.544414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 35/67] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:26.557742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a88a2-f09e-48aa-bd94-48c63cb48df1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.558403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a88a2-f09e-48aa-bd94-48c63cb48df1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.558849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a88a2-f09e-48aa-bd94-48c63cb48df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.574671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc043e-5586-4f4c-a682-e2c8b41e9e6e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:26.577985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4c3a88a2-f09e-48aa-bd94-48c63cb48df1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:26.579437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4c3a88a2-f09e-48aa-bd94-48c63cb48df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:26.604579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:26.614214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:26.615207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.615646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.616126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.617151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:26.617595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:26.619653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:26.630126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 33/68] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:26.632997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.676241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 36/69] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:26.680580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752764e4-fa98-4f8e-b4b5-85eecf282743 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.681701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752764e4-fa98-4f8e-b4b5-85eecf282743 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.683790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752764e4-fa98-4f8e-b4b5-85eecf282743 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.686858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 37/70] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:26.689173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752764e4-fa98-4f8e-b4b5-85eecf282743 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.762854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fbdb-1a74-46c7-a0d6-151df6ccbdc9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:26.805255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:26.806090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.806358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.806635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.807964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:26.809433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715a6c-c89e-4dfd-8392-68267659d185 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:26.815908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 34/71] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:26.815908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.815908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.815908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.828373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:26.834971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:26.836254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:26.876501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752764e4-fa98-4f8e-b4b5-85eecf282743 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:26.934318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:26.936049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:26.936541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:26.937043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:26.943787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 35/72] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:26.944781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.965900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:26.969256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:26.972582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 38/73] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:26 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:26.974265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:26.992803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.076605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10604-1076-434d-b8b3-6e4d1ab0f913 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:27.116385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57104c7-ba10-4810-92d3-9a68cb17644c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:27.124648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:27.125901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.126346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.126835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.131792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.147931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2b397c42-2723-4c07-8cac-4ec680a52f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:27.161540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:27.162811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:27.163918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 36/74] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:27.165829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9a56-9913-4d23-b988-3c8ccbe78a52 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.166370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9a56-9913-4d23-b988-3c8ccbe78a52 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.166852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9a56-9913-4d23-b988-3c8ccbe78a52 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.169527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 37/75] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:27.170982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9a56-9913-4d23-b988-3c8ccbe78a52 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:27.175434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:27.177404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.177796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.178162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.179295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:27.182149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:27.213239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:26 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:27.215109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:27.329385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.362946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9a56-9913-4d23-b988-3c8ccbe78a52 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:27.383647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8dab-7fac-4e66-8436-8d94146792ce None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:27.427854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:27.428797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.429086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.429364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.437898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:27.438844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.439274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.439697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.443809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:27.452559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:27.453596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:27.454426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:27.456964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 40/77] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:27.458617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:27.552094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.562691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:27.567024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:27.635014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2d45-72ae-4504-95ed-3d664d617023 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:27.687513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.702286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:27.704334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.705130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.705665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.707152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:27.707787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:27.711087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1902eb-2b55-4712-bcaa-dcd4fa51cac5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:27.730092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 41/78] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:27.732339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:27.732996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:27.733462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:27.751483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 38/79] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:27.753460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:27.765570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:27.767509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:27.912430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 42/80] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:27.912979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:27.939510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:27.959424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195b44c-413b-4e3b-ae7b-bb7459ef4dc2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.009995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.010705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.010992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.011267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.012080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:28.012394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.013849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.026910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 39/81] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:28.027918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.141417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586475-0932-430b-9c9e-5640e9440c65 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.164357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c003-0009-453b-aef3-c583dc7fea7c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.187512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:28.211290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.213426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.213937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.214329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.214611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.214884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.215535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.216679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.216952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.218224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.219984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.220582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 40/82] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:28.221372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.224435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.229399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 43/83] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:27 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:28.231556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.265888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:28.378477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f45c1c-e72b-42fd-b105-72bc73d8f34b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.427941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2940b64-bfa0-441f-947f-1c75958583b5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.429684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.430686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.431032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.431378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.448764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:28.459973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:28.461663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:28.463068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:28.466783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 41/84] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:28.467805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.502060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.504132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.504918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.505663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.508334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.511393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.514995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 44/85] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:28.516818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.595056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:28.619366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:28.625910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ae69-112c-4a38-adf8-840ce80e78b1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.673028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd6d81-06e3-4242-b24f-0d9c2067de67 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.692175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.693755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.694518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.695261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.697279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:28.698154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.701281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.715820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.716878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.717166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.717451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:28.719571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 42/86] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:28.721504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.806163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:28.808643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:28.891083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:28.927200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1959c-a517-443d-be4b-5509d893dcaa None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:28.961203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 45/87] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:28.961973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:28.996220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:28.997678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:28.998388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:28.999039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:29.000628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:29.001347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:29.003798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:29.021596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 43/88] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:29.023592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:29.071492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:29.216432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae977-f43f-47dd-b5ac-39e35068370f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:29.305427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e06c-26e1-42b2-9bba-3dff7206d7ec None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:29.336777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:29.337461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:29.337746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:29.338023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:29.372353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:29.374173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:29.374852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:29.375544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:29.378067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:29.381844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:29.385421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 44/89] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:29 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:29.387240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:29.406407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:29.555415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:29.558596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:29.569681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:29.611793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76865-48eb-42ae-af93-2da72760d071 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:29.681466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:29.683534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:29.686092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:29.687199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:29.689810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:29.691659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:29.693784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 45/90] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:29 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:29.694360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:29.836209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 46/91] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:29.837865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:29.974853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:29.986388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8d2d-4764-4b0c-90fe-0988e16033e2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:30.051949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce2188-10f6-48c0-8c85-da932538e287 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:30.066300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:30.067096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.067533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.067814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.068712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=d45573389f8249aaa5d35d830a5a6625) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:30.069023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:30.070526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:30.081280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 46/92] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:29 2022] GET /identity/v3/role_assignments?user.id=d45573389f8249aaa5d35d830a5a6625&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:30.084020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:30.126528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:30.185381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:30.186577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.187073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.187629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.386531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0abada-dc5f-4a7c-8fa7-6de71ad8a0c5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:30.457872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:30.460868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82e11-2a71-4530-9730-da98d3607c12 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:30.480031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:30.481687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.482123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.482537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.489624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:30.492181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:30.496642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 47/93] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:30 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:30.503162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:30.655475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:30.724418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:30.768215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a13b9b-6283-492b-a0cd-b6f28165427d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:30.819489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 47/94] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 983 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:30.820958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e100a-4224-45f3-a9bf-c1763af9a116 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.821259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e100a-4224-45f3-a9bf-c1763af9a116 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.821540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e100a-4224-45f3-a9bf-c1763af9a116 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.832187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 48/95] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:30.841948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf4d2-cc0b-4806-96e0-7c9ebeba059c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.842580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf4d2-cc0b-4806-96e0-7c9ebeba059c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.843042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf4d2-cc0b-4806-96e0-7c9ebeba059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.863237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad81-5666-408a-a785-10383002e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:30.864420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad81-5666-408a-a785-10383002e297 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:30.864923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad81-5666-408a-a785-10383002e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:30.865415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad81-5666-408a-a785-10383002e297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:30.867042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013ad81-5666-408a-a785-10383002e297 None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:30.867595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013ad81-5666-408a-a785-10383002e297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:30.874802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013ad81-5666-408a-a785-10383002e297 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:30.882026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9a8cf4d2-cc0b-4806-96e0-7c9ebeba059c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:30.884094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9a8cf4d2-cc0b-4806-96e0-7c9ebeba059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:30.887315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 48/96] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:30 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 259 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:30.889285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad81-5666-408a-a785-10383002e297 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.089673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad81-5666-408a-a785-10383002e297 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:31.130661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:31.131913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.132461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.132872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 49/97] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:31.133164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] PATH_INFO: `/v3/projects/da20d5de735b416289dc0c1841498507` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.134765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] RBAC: Authorizing `identity:get_project(project_id=da20d5de735b416289dc0c1841498507)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:31.135260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d68d-872f-421e-8ade-9c4f2ae6b3ab None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.135761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d68d-872f-421e-8ade-9c4f2ae6b3ab None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.136321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d68d-872f-421e-8ade-9c4f2ae6b3ab None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.138049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:31.139200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 50/98] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:31.140248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 49/99] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:30 2022] GET /identity/v3/projects/da20d5de735b416289dc0c1841498507 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:31.146225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.146725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.147134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.150299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.181022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:31.190036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:31.191866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:31.330057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 51/100] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:31.331209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.377393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:31.390874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff834b-a66a-418e-ba39-b3881acff316 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:31.432686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:31.433752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.434223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.434682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.435845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=da20d5de735b416289dc0c1841498507, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:31.436414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:31.438094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:31.445070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 50/101] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:31 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=da20d5de735b416289dc0c1841498507&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:31.446350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.538301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:31.556936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f57fa-3ba7-4f81-99d2-3b47ed9a3c55 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:31.567858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd92b84-96e3-4ecb-84c4-a2105c18c9cb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:31.611448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:31.612480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.612866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.613502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.626352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:31.630207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:31.632064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.632825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.633575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:31.635074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:31.636963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:31.638695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:31.639877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 51/102] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:31.641512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:31.645168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:31.645423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.649340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 52/103] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:31.660947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.764915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b236ef-158f-47b9-bb9b-2a5036717c6c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:31.808910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:31.809604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:31.809884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:31.810165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:31.810944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:31.811253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:31.813070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:31.820416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:31.827827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 52/104] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:31.836187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:31.897941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:31.946877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76553f0-4364-4bcc-80ce-b99f8cb57090 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:32.047216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:32.047922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:32.048267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:32.048554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:32.049793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:32.050853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:32.067078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b441fda-5161-442e-adbc-6708eb46f045 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:32.110699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:32.111645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:32.111820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 53/105] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:49:31 2022] POST /identity/v3/projects => generated 302 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:32.111952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:32.112230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] PATH_INFO: `/v3/users/29315ec535b54c75b9e481c52eb09201` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:32.145062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] RBAC: Authorizing `identity:get_user(user_id=29315ec535b54c75b9e481c52eb09201)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:32.146779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:32.149257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 53/106] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:31 2022] GET /identity/v3/users/29315ec535b54c75b9e481c52eb09201 => generated 289 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:32.154777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:32.331131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb663-b19e-4ea5-80ce-0236b637afc5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:32.380077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:32.380763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:32.381054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:32.381335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:32.388479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:32.541698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:32.544237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:32.789917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 54/107] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:32.798686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:32.891417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:32.950451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2f13b-a465-4df4-9dbd-2b08d8ff1a10 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:32.991499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:32.992436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:32.992719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:32.992998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:32.994303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:32.995778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02173bc-d68b-484c-b9bf-acaab8af3776 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:32.997551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 54/108] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:32 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:33.008014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:33.096725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:33.251217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b72a5-d947-46a7-90f9-b28d1a22365f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:33.337751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:33.338806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:33.339285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:33.339747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:33.341755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=29315ec535b54c75b9e481c52eb09201) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:33.342305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:33.345071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a474-a87c-48e6-b21d-d6f3e65ee2ec None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:33.360237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 55/109] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:33 2022] GET /identity/v3/role_assignments?user.id=29315ec535b54c75b9e481c52eb09201&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3ecff949085e494898251029e6bc12d4 => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:33.875464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14184b-8eef-4804-8dc7-28bbf36b41cd None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:33.876573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14184b-8eef-4804-8dc7-28bbf36b41cd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:33.877070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14184b-8eef-4804-8dc7-28bbf36b41cd None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:33.879107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 55/110] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:33.885514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:33.886476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:33.886984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:33.906262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:33.907849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:34.016512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 56/111] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:34.046994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14184b-8eef-4804-8dc7-28bbf36b41cd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.185093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14184b-8eef-4804-8dc7-28bbf36b41cd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:34.220364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:34.234113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:34.235315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.235609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.235889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.251283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cca986c0-7d96-43c4-aa6c-3fe1acf40ec1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:34.260175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:34.261113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:34.261868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 56/112] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:34.267706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.294485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eaaa-0081-4a60-b59d-5e8f87ba898a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.294485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eaaa-0081-4a60-b59d-5e8f87ba898a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.294485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eaaa-0081-4a60-b59d-5e8f87ba898a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.294485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 57/113] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:34.300725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.301327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.301986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.333063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:34.335348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:34.353877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:34.429067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 58/114] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:34.451178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.503875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ecb61-9f14-411d-b48c-46d470fd901e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:34.560146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c02c4-6321-4549-88cb-329ec737e495 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:34.569169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:34.570394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.570889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.571366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.572358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:34.572899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:34.574611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:34.588044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:34.593642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:34.595982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:34.596827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.597110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.597718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.602766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.609789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:34.617902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:34.618845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:34.619616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 59/116] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:34.625028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.721643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:34.734478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cddcf3-e667-4820-8ea0-1e94ea7911c5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:34.751120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e87a-94d2-4836-a9df-3d3ffaf00426 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:34.790424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:34.791744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.792271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.792742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.796881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:34.798667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:34.808543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 58/117] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:34.818014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:34.862528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:34.865435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:34.865950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:34.866470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:34.867634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:34.874150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:34.877945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:34.904164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 60/118] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:34.906703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:35.012087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766fd3d-8172-4e2f-9455-10594d03ca2d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:35.045622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:35.069571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:35.070928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.071434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.071913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.077600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:35.079584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:35.083110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 59/119] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:35.099444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:35.140659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:35.237833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c656-2ab7-4c9c-928e-91e0c8078e73 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:35.295513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:35.296867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.297354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.298470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.305865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, user_id=add61fbfd50a4ffc9945b8b3c878bee1, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:35.307746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:35.323132 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee17cae-a1a4-4e2c-9ebf-14f0a93770a7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:35.343769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 60/120] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:35 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:35.432197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:35.433732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.434256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.434770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.437208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:35.440021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:35.443291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 61/121] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:34 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:35.449142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:35.578395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:35.598749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68535c0-ebc4-41d9-9351-cc67a04cd914 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:35.660580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:35.661993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.662503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.662968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.668599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:35.670457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc0d44-f967-4e3c-89ee-e7c3a090b6dd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:35.672564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 61/122] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:35 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:35.679501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:35.842413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a9d8-0acf-46c4-8fc1-577bb10731da None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:35.845346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:35.854070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e701-f813-4fa8-b1ef-d75484c62150 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.854945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e701-f813-4fa8-b1ef-d75484c62150 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.855646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e701-f813-4fa8-b1ef-d75484c62150 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.859332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 62/123] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:35.866260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.866570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.866827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.908577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:35.909283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:35.909522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:35.909850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:35.910278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/d45573389f8249aaa5d35d830a5a6625/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:35.910540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:35.912772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, user_id=d45573389f8249aaa5d35d830a5a6625, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:35.914376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:35.939905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 62/124] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:35 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/d45573389f8249aaa5d35d830a5a6625/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:36.072620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 63/125] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:36.095656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:36.306785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98c8f8-2a87-4d6c-93b0-8da7569e2616 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:36.381535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:36.382784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.383225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.383654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.410629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2090aad4-99ed-45de-9b93-c110c53667d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:36.418903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:36.419841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:36.420659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:36.426731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:36.465209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3308-635f-46d9-b3d6-10f66c15da31 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.465598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3308-635f-46d9-b3d6-10f66c15da31 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.465814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3308-635f-46d9-b3d6-10f66c15da31 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.467816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 64/127] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:36.474891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.475267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.475478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.506348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:36.510124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:36.560586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:36.593803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:36.614935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27437be6-98e2-44f1-b824-545e2b40a330 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:36.655307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:36.656403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.656932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.657350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.658295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:36.658760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:36.660471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:36.671103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 64/128] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:36.682524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:36.702883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 65/129] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:36.739767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:36.871843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17dab7-07ee-402e-8f63-cdb26248581c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:36.949156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:36.950179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.950477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.950748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.953108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:36.954680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995be400-bc45-4e5e-9b10-9f0d667de60d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:36.956614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 65/130] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:36 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:36.958134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437d92-94e4-480c-9736-57cfe02b8fea None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:36.958427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437d92-94e4-480c-9736-57cfe02b8fea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:36.958707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f437d92-94e4-480c-9736-57cfe02b8fea None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:36.960812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 66/131] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:36.972399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f437d92-94e4-480c-9736-57cfe02b8fea None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:36.976049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f7394-6416-4d0b-93b8-d7df731b4b33 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.017663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:37.032124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.033762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.034106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.034642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.055521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a6dfee63-42f4-414a-be6a-2bb554cfcd0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:37.071614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:37.072606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:37.073381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:37.073967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:37.081841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.082545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.083026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.134481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:37.136469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:37.171763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:37.287109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f437d92-94e4-480c-9736-57cfe02b8fea None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.311920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 67/133] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:37.312737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:37.358663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.359631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.359921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.360234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] PATH_INFO: `/v3/projects/da20d5de735b416289dc0c1841498507` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.361602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] RBAC: Authorizing `identity:get_project(project_id=da20d5de735b416289dc0c1841498507)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:37.363251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:37.366653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 67/134] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:36 2022] GET /identity/v3/projects/da20d5de735b416289dc0c1841498507 => generated 312 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:37.373988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:37.575891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:37.598660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35ce4-f1b2-45c8-a29c-4b9df5e102e3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.621125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8070-c484-409e-b95b-d43e0f98d3ea None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.639231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.640096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.640383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.640662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.641970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:37.643474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:37.645642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 68/135] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:37.646339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:37.698079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.699436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.699938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.700491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.702024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:37.702556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:37.705206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:37.721807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 68/136] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:37.723363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:37.739750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:37.841544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf385-3374-4624-bc58-0cdfae251881 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.888481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.890037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.890513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.890990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] PATH_INFO: `/v3/projects/da20d5de735b416289dc0c1841498507/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.894848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=da20d5de735b416289dc0c1841498507, user_id=add61fbfd50a4ffc9945b8b3c878bee1, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:37.897669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:37.905882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af012-20dc-45ef-b0dd-b5385999a54b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:37.922823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 69/137] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:37 2022] PUT /identity/v3/projects/da20d5de735b416289dc0c1841498507/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:37.924826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:37.951257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:37.952769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:37.954144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:37.954726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:37.955344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:37.956324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:37.958433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce756f-5b3f-4e38-addd-ed5ff7cacb6d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:38.008335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 69/138] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:37 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:38.009829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bac3-9677-43dc-8685-284f0de9fd92 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.010129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bac3-9677-43dc-8685-284f0de9fd92 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.010412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bac3-9677-43dc-8685-284f0de9fd92 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.012164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 70/139] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:38.017983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.018391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.018564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.045418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:38.049862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:38.121543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556b056-019d-45e1-a259-4a8297863e24 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:38.165974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:38.167245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.167787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.168300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.169897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:38.171782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:38.174031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 70/140] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:37 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:38.181262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:38.264400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:38.310470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 71/141] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:38.361887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:38.366116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:38.402791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dedf0-849d-42f2-8230-e904665266db None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:38.455112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:38.456958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.457979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.459027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.461359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:38.463806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:38.465909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 71/142] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:38 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:38.473881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:38.533308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8377-54aa-4c5b-8191-a7fe4089284b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:38.602099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:38.602925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.603209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.603482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.626692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:38.638105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:38.639115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:38.639864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:38.640983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 72/143] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:38.655781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:38.707477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f33602-a810-4b07-a23e-fd466e044657 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:38.733936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:38.815385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:38.817394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.817904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.818959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.831518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, user_id=add61fbfd50a4ffc9945b8b3c878bee1, role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:38.835931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:38.869757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee5662-550b-4c16-aaa0-4d3bec1f2564 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:38.883579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 72/144] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:38 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/add61fbfd50a4ffc9945b8b3c878bee1/roles/3fac18083f284da8a654bbbc3a62d49b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:49:38.971499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:38.972678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:38.973177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:38.973663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:38.975135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:38.975689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:38.978508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bb9d8-fce4-43ec-97ec-f8fa8696e84a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:39.012354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 73/145] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:39.019214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:39.041779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:39.297331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2125c-cafb-4da3-861b-31babef85e17 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:39.320419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef83d0-2397-4308-a5bc-197e24164852 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:39.320939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef83d0-2397-4308-a5bc-197e24164852 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:39.321447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef83d0-2397-4308-a5bc-197e24164852 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:39.324247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 74/146] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:39.334614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:39.335117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:39.335583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:39.392710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:39.394884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:39.435485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:39.437119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:39.437631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:39.438136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] PATH_INFO: `/v3/users/29315ec535b54c75b9e481c52eb09201` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:39.442047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] RBAC: Authorizing `identity:get_user(user_id=29315ec535b54c75b9e481c52eb09201)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:39.450643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:39.455407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 73/147] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:39 2022] GET /identity/v3/users/29315ec535b54c75b9e481c52eb09201 => generated 289 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:39.463197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:39.598813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 75/148] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:39.638642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:39.652443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:39.723816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243eb7-09e1-43e4-8a99-51952773fdf5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:39.760933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:39.827253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:39.828576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:39.829066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:39.829512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:39.831322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:39.835004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:39.844442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 74/149] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:39 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:39.850267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:39.932538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add1ed8-6347-412e-a470-067a1713bd7f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:40.007671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:40.008673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.008961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.009234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.061368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:40.063013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d07510-0b90-4bed-aceb-ff36d78604bc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:40.104763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:40.106377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:40.107859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:40.116139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 76/150] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:40.122227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:40.123110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:40.124408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.124886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.125370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/29315ec535b54c75b9e481c52eb09201/roles/3ecff949085e494898251029e6bc12d4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.133558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, user_id=29315ec535b54c75b9e481c52eb09201, role_id=3ecff949085e494898251029e6bc12d4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:40.135363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:40.160740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 75/151] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:39 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/users/29315ec535b54c75b9e481c52eb09201/roles/3ecff949085e494898251029e6bc12d4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:49:40.403512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c0f0-4b3b-4fa2-861a-bc0878c0a473 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:40.414036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:40.490164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:40.491354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.491837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.492356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.493836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:40.494378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:40.497045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:40.518296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 77/152] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:40.526158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:40.535082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:40.688943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2a20-37dd-4378-9d44-81914475018b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:40.728195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:40.729114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.729504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.729782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.731449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:40.733029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82bb1-fded-4260-9cd5-49a2f0e31db1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:40.734743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 76/153] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:40 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:40.744661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:40.818110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1098-6102-4d1d-a574-e894127b1678 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.818460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1098-6102-4d1d-a574-e894127b1678 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.818669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1098-6102-4d1d-a574-e894127b1678 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.820359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 77/154] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:40.827176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:40.827469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:40.827739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:40.850550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:40.852042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:40.949615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18bb15-fe5f-47e9-9343-b4260222e096 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:40.991290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:40.999562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 78/155] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:41.014946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b541-0712-4515-b525-36912388bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:41.015903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b541-0712-4515-b525-36912388bda6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:41.016338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b541-0712-4515-b525-36912388bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:41.016749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329b541-0712-4515-b525-36912388bda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:41.056806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.108379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.184122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b541-0712-4515-b525-36912388bda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:41.186177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329b541-0712-4515-b525-36912388bda6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:41.219676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7374c-c124-4c07-99b6-c18df215b40e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:41.266300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:41.267537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:41.268068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:41.268528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:41.285406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:41.302129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:41.303167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:41.303942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:41.306889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 79/156] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:41.312956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.388691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.452152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdc76-ce85-4985-b3f6-d29d07ad7a4d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:41.494892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:41.495885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 78/157] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:41.496216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:41.496694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:41.497295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:41.498291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:41.498796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:41.500520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:41.501690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b541-0712-4515-b525-36912388bda6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.511487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 80/158] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:41.517622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.635628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9b7f-6e03-4702-b9bc-ea2691cac1c8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:41.668412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.685056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:41.686003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:41.686293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:41.686574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] PATH_INFO: `/v3/users/d45573389f8249aaa5d35d830a5a6625` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:41.688156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] RBAC: Authorizing `identity:get_user(user_id=d45573389f8249aaa5d35d830a5a6625)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:41.689998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:41.693206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 81/159] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/users/d45573389f8249aaa5d35d830a5a6625 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:41.699502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.700682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:41.810479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329b541-0712-4515-b525-36912388bda6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:41.904979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:41.905919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:41.906215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:41.906491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:41.911392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:41.912964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:41.915291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 79/160] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:41.929849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:41.955484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e88f4-3c9f-4aa8-95ad-958b7300661e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:42.031008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:42.031697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:42.032006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:42.032298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:42.150692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:42.177361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:42.178896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:42.192286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17429-352c-4c16-ab61-f5ec28f1e9db None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:42.256833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:42.257655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:42.257971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:42.258209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:42.259172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:42.259486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:42.261120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:42.263301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:42.272688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 80/161] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:42.356209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 82/162] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:42.362906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:42.533533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623a2c-88fc-4901-a0b9-13b47b7c61ef None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:42.584491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:42.585419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:42.585686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:42.585954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:42.593086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:42.594639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea6d08-c65b-406b-9ffe-5f0ad409aac2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:42.596616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 81/163] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:42 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:42.603263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:42.744071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:42.761029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2258235-e46b-4967-8eb9-7d7967539249 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:42.806888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:42.807609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:42.807902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:42.808214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:42.809132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=d45573389f8249aaa5d35d830a5a6625) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:42.809449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:42.811256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ff288-c2b7-40da-aec7-8a45fc0e928b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:42.821875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 83/164] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:42 2022] GET /identity/v3/role_assignments?user.id=d45573389f8249aaa5d35d830a5a6625&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:43.200462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64472b2-ad4c-4238-b735-7595c54761b5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.200983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64472b2-ad4c-4238-b735-7595c54761b5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.201343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64472b2-ad4c-4238-b735-7595c54761b5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.204294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 82/165] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:43.222984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.223464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.223949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.253336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:43.254642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:43.355854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 84/166] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:43.451216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64472b2-ad4c-4238-b735-7595c54761b5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:43.528721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:43.572176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64472b2-ad4c-4238-b735-7595c54761b5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:43.615801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:43.616652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.616942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.617208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.633922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-895565c0-2300-4347-a1c0-cee67727fa8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:43.642241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:43.643205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:43.644281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 83/167] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:43.652660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:43.747031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:43.770294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e45c6-0b74-4d90-bf2e-b5f3b38990a6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:43.811516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:43.812246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.812531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.812812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.813577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:43.813887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:43.815306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:43.825366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 85/168] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:43.834261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214113-0c74-404a-9e69-d8226b3b21fb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.834551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214113-0c74-404a-9e69-d8226b3b21fb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.834823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214113-0c74-404a-9e69-d8226b3b21fb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.836389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 84/169] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:43.837269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:43.847865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:43.848249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:43.848451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:43.872413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:43.874356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:44.084017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 85/170] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:44.095942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83efc-c0ec-4701-a555-a2829d6e070c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:44.116225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.187351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:44.188289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.188570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.188843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.190310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:44.192534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51423ede-e1a8-4e82-8c20-0ddf9d75a43a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:44.194417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 86/171] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:43 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:44.195469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad188a-71a1-4b8e-9dd0-192c6ba8d812 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.195757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad188a-71a1-4b8e-9dd0-192c6ba8d812 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.196047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad188a-71a1-4b8e-9dd0-192c6ba8d812 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.197415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 87/172] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:44.210427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.210772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.210982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.240216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.250178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:44.251400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:44.274708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.347805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d30f0-2fb9-4c26-99d4-826f3094f60b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:44.390380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 88/173] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:44.392113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.402341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:44.403496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.403984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.404467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.417091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-683f50fb-e1f2-4a1d-a9db-ee78c9c66bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:44.425980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:44.426911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:44.427725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:44.430780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 86/174] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:44.437339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d7f5e-1550-4553-adfb-c2b362472ab9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.437946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d7f5e-1550-4553-adfb-c2b362472ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.438464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d7f5e-1550-4553-adfb-c2b362472ab9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.440415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 87/175] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:44.441487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d7f5e-1550-4553-adfb-c2b362472ab9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.565835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87e61-9098-4b87-98b0-18033350bce1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:44.569858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d7f5e-1550-4553-adfb-c2b362472ab9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:44.589452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.609806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:44.610016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:44.610388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.610551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.610719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.610817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.610982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.611070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.612315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:44.614543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:44.616425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 88/176] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:44.617050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.632238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.694623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:44.696620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60012e-2555-4a88-ab28-863fbcf3d581 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:44.736879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6de1-69f3-4277-96bc-ef2e31c5834d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:44.776564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75559132-28c3-4506-a235-174632a127bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:44.777248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75559132-28c3-4506-a235-174632a127bf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.777561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75559132-28c3-4506-a235-174632a127bf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.777834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75559132-28c3-4506-a235-174632a127bf None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.778629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75559132-28c3-4506-a235-174632a127bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:44.778932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75559132-28c3-4506-a235-174632a127bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:44.780371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75559132-28c3-4506-a235-174632a127bf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:44.790275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 89/177] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:44.791554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.791839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.792147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.809879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:44.811091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:44.823080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 89/178] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:44.824784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6d5e-add4-4786-a09b-3d87ce5003b1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:44.825081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6d5e-add4-4786-a09b-3d87ce5003b1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:44.825356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6d5e-add4-4786-a09b-3d87ce5003b1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:44.831393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 90/179] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:44.831393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6d5e-add4-4786-a09b-3d87ce5003b1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.872290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.887329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:44.914600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 90/180] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:44.915441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:44.992307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6d5e-add4-4786-a09b-3d87ce5003b1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.032361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.033166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.033454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.033731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.034480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:45.038102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:45.067524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 91/181] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:44 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:45.068504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:45.103495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01cea7-eb8b-4ff0-84e7-c9030d4134f5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.162213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.163042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.163361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.163655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.183242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:45.184868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac79201-e3fe-4794-92b1-7e95196c31b0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:45.187030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 91/182] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:44 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:45.188252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.188572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.188879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.210416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:45.212056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:45.245693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:45.251113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20527-6394-4edb-9063-6a8536356576 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.258390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:45.305250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.306188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.306447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.306729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] PATH_INFO: `/v3/projects/da20d5de735b416289dc0c1841498507` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.308154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] RBAC: Authorizing `identity:get_project(project_id=da20d5de735b416289dc0c1841498507)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:45.309690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:45.316053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 92/183] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/projects/da20d5de735b416289dc0c1841498507 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:45.316053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:45.351007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 92/184] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:45.352755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:45.445012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96f02-175a-4bdc-ab62-95cc08c7b82c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.499375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.501336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.502125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.502796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.524962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5b2c-b6d9-4284-9654-73b476760d0c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.525208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ee2dade2-5796-4f92-974f-af4686e25f70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:45.533614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:45.535278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:45.536672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 93/185] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:45.537757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02e41-35b0-45ac-a53e-7af30d52c0ef None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.537757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02e41-35b0-45ac-a53e-7af30d52c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.537757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02e41-35b0-45ac-a53e-7af30d52c0ef None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.538910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 94/186] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:45.540109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da02e41-35b0-45ac-a53e-7af30d52c0ef None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:45.585197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.586424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:45.589277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.591417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.591417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.637750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:45.707414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:45.712042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:45.764223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da02e41-35b0-45ac-a53e-7af30d52c0ef None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:45.816042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:45.816042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:45.816042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:45.816042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:45.816480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=da20d5de735b416289dc0c1841498507, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:45.816480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:45.820017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:45.830480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 95/187] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=da20d5de735b416289dc0c1841498507&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:45.830480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:45.852286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 93/188] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:45.853688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.000498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.100265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.125302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec7874-a28d-45cf-ac0d-6c98b6044564 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.130285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fe564-6e54-4d85-93fe-ab46b6605b3e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.179684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.181258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.181781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.182417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.183544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:46.184096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:46.187100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e1671-07e7-42ba-bfba-41d55ba402b6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:46.198674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:46.204113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.204113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.204113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.204113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.205112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.205590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.206133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.227394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:46.231262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:46.233228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:46.237030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:46.237991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:46.238791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:46.241525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 96/190] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:46.242627 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.380160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996f65b-aefb-4679-8820-87cf6cbe34a4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.393684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 95/191] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:46.395764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.447895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.449342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.449754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.450148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.452217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:46.454926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:46.458615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:46.460020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.491580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.495320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.570709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49697b6d-4147-4127-9c5f-bfe8b2223a58 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.619298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814708c-7627-4347-9559-dfa795ae1088 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.621720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.623034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.623377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.624482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] PATH_INFO: `/v3/users/add61fbfd50a4ffc9945b8b3c878bee1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.626360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=add61fbfd50a4ffc9945b8b3c878bee1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:46.628060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:46.630432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/users/add61fbfd50a4ffc9945b8b3c878bee1 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:46.631329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.684392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.685712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.686149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.686619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.687858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:46.688417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:46.690840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:46.706899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 98/194] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:46.708468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.780178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef778-7d0e-41c1-9922-af1125696ae1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.810945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.816148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:46.834097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.834930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.835253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.835421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51234f3c-5613-4271-884a-5838008e86e2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:46.835936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.852263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:46.862191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:46.864946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:46.866917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:46.876034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 97/195] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:46.876034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:46.884593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:46.885816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:46.886248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:46.886611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:46.887663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=b15539a2f2f34eada48b968580e5f4ae) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:46.888097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:46.890496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:46.900724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 99/196] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/role_assignments?user.id=b15539a2f2f34eada48b968580e5f4ae&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:46.902592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:47.003891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144e6a-ad68-4145-a352-8a9d10850781 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:47.135665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:47.136681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:47.137138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:47.137635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:47.192959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ae73d-ccd8-47d3-96a3-3498e034f5fa None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:47.258301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:47.278866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:47.280710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:47.318976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:47.320625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:47.321124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:47.321997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:47.328802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:47.331928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:47.343813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 100/197] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:47.345640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:47.398589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 98/198] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:47.400790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:47.401485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:47.510272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:47.529952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7d68-0627-426a-9307-eec6dc649a02 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:47.585687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:47.586374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:47.586657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:47.586931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:47.653032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65e5f-5de3-4b26-870d-095e89fbf2d9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:47.719905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:47.721438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:47.769325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:47.770536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:47.771050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:47.771560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:47.773117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:47.773680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:47.776814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:47.824299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 101/199] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:47.826117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:47.836410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:47.838776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 99/200] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:47.842603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:47.958188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5fec-d25e-4f3d-b88d-a3d68cbf5b59 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.009092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.017282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.017794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.018244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] PATH_INFO: `/v3/users/29315ec535b54c75b9e481c52eb09201` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.019982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] RBAC: Authorizing `identity:get_user(user_id=29315ec535b54c75b9e481c52eb09201)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.022900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.028312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 100/201] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:47 2022] GET /identity/v3/users/29315ec535b54c75b9e481c52eb09201 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:48.029646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:48.128467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:48.179541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a8fff-136e-4f85-a44b-cfd7edf33daf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.219075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.220253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.220681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.221119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.222597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.224282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.226478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 101/202] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:48 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:48.227478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:48.272269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:48.314206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfebc-43a8-4029-b800-20cc7274e402 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.360786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9702e-f2f9-45c8-98e6-a7513e3d260e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.396324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:48.402674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.404216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.404744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.405756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.425684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.426676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.426964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.427239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.428648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.430134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.436193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 102/203] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:47 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:48.436193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:48.568082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4778-db7f-4e21-8ff0-7a9ef4af164c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.578674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.580403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0df16b-bcb6-4152-9f0f-e3487a5b49b9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.609268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.610870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.611362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.611834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.613030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=b15539a2f2f34eada48b968580e5f4ae) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:48.613557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.615818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf318-9a73-4d64-a071-969842d75dbf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.623086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 103/204] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:48 2022] GET /identity/v3/role_assignments?user.id=b15539a2f2f34eada48b968580e5f4ae&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:48.634771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb61a-d307-4009-9b90-d8dd90cfc231 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.635687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb61a-d307-4009-9b90-d8dd90cfc231 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.636202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb61a-d307-4009-9b90-d8dd90cfc231 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.638076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 104/205] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:48.639038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb61a-d307-4009-9b90-d8dd90cfc231 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:48.663757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:48.832390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 102/206] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:48.834823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6de4-4adf-42aa-90ae-99e1b12070db None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.835334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6de4-4adf-42aa-90ae-99e1b12070db None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.835809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6de4-4adf-42aa-90ae-99e1b12070db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.857364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb61a-d307-4009-9b90-d8dd90cfc231 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:48.897827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fb9b6de4-4adf-42aa-90ae-99e1b12070db None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:48.899159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:48.899829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fb9b6de4-4adf-42aa-90ae-99e1b12070db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:48.900040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:48.900178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:48.900467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:48.901241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=add61fbfd50a4ffc9945b8b3c878bee1) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:48.901567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:48.903091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:48.912527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 105/207] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:48 2022] GET /identity/v3/role_assignments?user.id=add61fbfd50a4ffc9945b8b3c878bee1&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:48.913164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:48.939648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:49.058094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:49.110921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 103/208] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:49.113302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed04-35b6-4825-9fe2-917ccab5a0dc None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.113807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed04-35b6-4825-9fe2-917ccab5a0dc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.114309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed04-35b6-4825-9fe2-917ccab5a0dc None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.116924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 104/209] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:49.123037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c579166-77d8-44be-a472-fd7162696b81 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:49.130865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.131356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.131830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.185858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:49.189357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:49.224976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:49.226559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.227065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.227565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.233657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:49.236894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:49.241190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 106/210] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:48 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:49.246305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:49.298715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 105/211] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:49.300043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:49.414685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:49.442406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc05658-36bb-4050-a687-ca100f2a3df6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:49.474744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6371e-44af-421d-995a-86a1c6fb1412 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:49.481184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:49.482278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.482753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.483226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.484336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, scope.project.id=0eb8c20d86434284896d07505a3ce80c, user.id=29315ec535b54c75b9e481c52eb09201) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:49.484852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:49.486564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:49.500353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 106/212] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:49 2022] GET /identity/v3/role_assignments?user.id=29315ec535b54c75b9e481c52eb09201&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3ecff949085e494898251029e6bc12d4 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:49.501702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:49.562394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:49.562394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.562853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.563254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.568158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:49.571281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:49.575045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 107/213] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:49.585218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:49.620877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:49.641903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb80602-0f6e-498a-80d7-782e020f09b7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:49.680159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:49.681770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.682294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.682762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.695869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:49.704816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:49.705821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:49.706715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:49.709408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 107/214] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:49.715567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:49.722185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:49.877101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaba9d-f7c7-4960-9a8e-4e850a1962f3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:49.941470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:49.942548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:49.943271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:49.943451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:49.944795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:49.947456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:49.991156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 108/215] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:49 2022] POST /identity/v3/users => generated 297 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:49:50.033144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770242b-060e-475d-bc80-c576836a63a6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:50.111637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:50.112895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.113397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.113895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.115350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:50.115899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:50.118615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afad88-1466-45ee-a6b0-438c6bb923c3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:50.138279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 108/216] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:50.147643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:50.298219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:50.373709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca97860-4220-437a-9c94-1ca1ee96b3d4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:50.414457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:50.415379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.415662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.415935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] PATH_INFO: `/v3/users/970619a2247d46c6bec254bb9dc279ea` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.431324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df8cb-72f0-45ea-bbbb-abafbecbb314 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.431843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df8cb-72f0-45ea-bbbb-abafbecbb314 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.431843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df8cb-72f0-45ea-bbbb-abafbecbb314 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.433526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 109/217] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:50.437034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] RBAC: Authorizing `identity:get_user(user_id=970619a2247d46c6bec254bb9dc279ea)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:50.438712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:50.440032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.440563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.440693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 109/218] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:50 2022] GET /identity/v3/users/970619a2247d46c6bec254bb9dc279ea => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:50.441344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.448846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:50.461264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:50.462603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:50.547280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:50.563178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 110/219] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:50.587281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca395cc-56f2-4d72-86e3-f191b25f95d9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:50.593482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:50.628256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:50.645320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:50.647947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.647947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.647947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.749674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:50.751489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:50.791896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c13a5-39b0-4cfd-a00f-cf6368bdfe11 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:50.830795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:50.831584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:50.831865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:50.832172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:50.844930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:50.854018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:50.855754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:50.857378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 111/220] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:50.861322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:50.927185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:50.968542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 110/221] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 20:49:50.985204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:51.059249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:51.081385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe74e7-63bc-4e3e-b02f-b878f255be21 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:51.155461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda929-561a-4c9a-863a-646fc5f8180a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:51.181328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:51.182564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:51.183080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:51.183589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:51.185217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:51.185759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:51.188578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:51.199281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:51.200314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:51.200596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:51.200878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:51.204942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:51.206576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:51.210464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 111/222] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:50 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:51.213020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 112/223] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:51.219582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:51.222851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:51.474968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:51.494933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7330b3-565d-4200-919e-1a846e1a506d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:51.560876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:51.561718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:51.561871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:51.562114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:51.562978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=970619a2247d46c6bec254bb9dc279ea) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:51.563290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:51.564845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:51.567426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b91ff-a942-438a-9a7e-cb8068eaaff5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:51.580118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 112/224] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:51 2022] GET /identity/v3/role_assignments?user.id=970619a2247d46c6bec254bb9dc279ea&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:51.607158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:51.649996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:51.652296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:51.653186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:51.653932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:51.656672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:51.658527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:51.666579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 113/225] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:51 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:51.668035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:51.859286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e82d45-e187-49a3-bbd7-516278c9f93e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:51.922772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:51.923680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:51.923956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:51.924254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:51.925659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:51.927155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa31f-a52a-4eed-a61f-88bb340646c5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:51.929027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 113/226] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:51 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:51.935967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:52.080529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc65f2-2cf9-46cf-a8ed-e5e7cebcf15b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:52.127903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:52.129058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:52.129521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:52.129808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/b15539a2f2f34eada48b968580e5f4ae/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:52.132085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, user_id=b15539a2f2f34eada48b968580e5f4ae, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:52.133629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:52.138539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767a76-ae4e-4665-874c-0c0b685a1ae7 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:52.138928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767a76-ae4e-4665-874c-0c0b685a1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:52.139111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767a76-ae4e-4665-874c-0c0b685a1ae7 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:52.140927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 114/227] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:52.147933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:52.148240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:52.148561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:52.163152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 114/228] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:51 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/b15539a2f2f34eada48b968580e5f4ae/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:52.185014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:52.186289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:52.213841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:52.306523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 115/229] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:52.369353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:52.444634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:52.525393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98014fa1-ab3c-4600-ad23-2ab8746c9011 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:52.568788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:52.570480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:52.570914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:52.571328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:52.586605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:52.596489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:52.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:52.598641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:52.600903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 115/230] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:52.609217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:52.835741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44d671-0fef-4ad8-91da-39b154640355 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:52.890192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:52.891226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:52.891676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:52.892138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:52.893096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:52.893578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:52.895786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:52.915597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 116/231] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:52.922298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:53.074167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71aff8-2cc1-41e4-a195-09f321125449 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:53.082987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:53.119020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:53.119845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:53.120269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:53.120718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:53.122440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:53.123927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:53.126080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 116/232] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:52 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:53.137216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:53.157981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:53.301052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291982-5d20-4187-9fb2-313c10efb50e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:53.358154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:53.359649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:53.360128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:53.360696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:53.362595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:53.364321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc84de-9981-433b-a405-220ac3141d74 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:53.367124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 117/233] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:53 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:53.375171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:53.508825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e263316-1543-422d-abc5-e575424b81e8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:53.549603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:53.550747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:53.551029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:53.551330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/b15539a2f2f34eada48b968580e5f4ae/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:53.558045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, user_id=b15539a2f2f34eada48b968580e5f4ae, role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:53.559528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cb60f-452b-47e4-b567-b285badf5f5a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:53.579571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 117/234] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:53 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/b15539a2f2f34eada48b968580e5f4ae/roles/3fac18083f284da8a654bbbc3a62d49b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:53.856625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b72-2bff-43db-b433-94cc7567dc3c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:53.857182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b72-2bff-43db-b433-94cc7567dc3c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:53.857182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3280b72-2bff-43db-b433-94cc7567dc3c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:53.858914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 118/235] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:53.865024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a450-505a-4484-87ea-5f67314e4b5e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:53.865345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a450-505a-4484-87ea-5f67314e4b5e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:53.865574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a450-505a-4484-87ea-5f67314e4b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:53.892092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c182a450-505a-4484-87ea-5f67314e4b5e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:53.893379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c182a450-505a-4484-87ea-5f67314e4b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:53.931331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:53.983262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 118/236] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:54.007357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3280b72-2bff-43db-b433-94cc7567dc3c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:54.120294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:54.144079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e9b-a780-456e-a1ed-f264cb80eced None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.144511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e9b-a780-456e-a1ed-f264cb80eced None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.144805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e9b-a780-456e-a1ed-f264cb80eced None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.146377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 119/237] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:54.152945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3280b72-2bff-43db-b433-94cc7567dc3c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:54.157888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05547582-e1ab-4032-90a6-784495eee436 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.158142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05547582-e1ab-4032-90a6-784495eee436 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.158556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05547582-e1ab-4032-90a6-784495eee436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.185468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-05547582-e1ab-4032-90a6-784495eee436 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:54.186680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-05547582-e1ab-4032-90a6-784495eee436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:54.238999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:54.239868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.240176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.240445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.265509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:54.277435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:54.278406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:54.279213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 119/238] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:54.285692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:54.372096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 120/239] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:54.396779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05547582-e1ab-4032-90a6-784495eee436 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:54.527731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dce862-ec10-4f4e-97b7-a61d33724f6d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:54.533067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:54.543303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05547582-e1ab-4032-90a6-784495eee436 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:54.591640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:54.593347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.593849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.594343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.596129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:54.598065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:54.601810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 121/240] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:54.607861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:54.636602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:54.637225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.637511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.638989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.642880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:54.643264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:54.645033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:54.660811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 120/241] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:54.677132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:54.688526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:54.750243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8882e2-345d-4e45-b6e5-b807d99b48a9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:54.791104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:54.792294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.792581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.792859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.793645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:54.795123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:54.830626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 122/242] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:49:54 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:49:54.884861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756e49d-bf5e-4858-8527-4b070cd00a12 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:54.932068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:54.933074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:54.933358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:54.933636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] PATH_INFO: `/v3/users/69746daa19474ed9ae822b04a1332e34` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:54.954217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] RBAC: Authorizing `identity:get_user(user_id=69746daa19474ed9ae822b04a1332e34)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:54.957157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167be0-64ca-49c2-a4fc-122c2f567e45 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:54.960933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 121/243] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:54 2022] GET /identity/v3/users/69746daa19474ed9ae822b04a1332e34 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:54.970539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:55.011127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:55.185854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf623-bc10-4b54-b54f-fde110a2f030 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:55.256298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:55.257432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.257921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.258401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.336778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d699dd-30e9-4460-90d2-162f04c02eda None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.337883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d699dd-30e9-4460-90d2-162f04c02eda None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.338678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d699dd-30e9-4460-90d2-162f04c02eda None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.342228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 122/244] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:55.353342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.354283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.355070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.398168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:55.401063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:55.404921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:55.407972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:55.452695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:55.542417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:55.582035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 123/245] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:55.631357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 123/246] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:55.640157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:55.640691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:55.882375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bcf94-1b29-4c32-b27b-c82dfe28778e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:55.889890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061f30b-94eb-496d-9eb2-76add321282c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:55.921837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:55.956111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af426c-6218-4882-8795-7f263b828403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:55.957581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af426c-6218-4882-8795-7f263b828403 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.958019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af426c-6218-4882-8795-7f263b828403 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.958459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af426c-6218-4882-8795-7f263b828403 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.960578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af426c-6218-4882-8795-7f263b828403 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:55.963176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af426c-6218-4882-8795-7f263b828403 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:55.966657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 124/247] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:55 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:55.969457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:55.970861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.971353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.971847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.974369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359160e-0ec0-4fbe-b3b7-57a0e8202fc6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.974803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359160e-0ec0-4fbe-b3b7-57a0e8202fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.975241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359160e-0ec0-4fbe-b3b7-57a0e8202fc6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.977655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 125/248] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:55.989877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:55.990332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:55.990773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:55.992650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:56.010172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:56.013690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 124/249] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:56.016651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:56.053747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:56.060157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:56.128514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:56.233954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06254c6-8400-4707-a0a6-848815b56fcf None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:56.306842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:56.308014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:56.308486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:56.308939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:56.310660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=69746daa19474ed9ae822b04a1332e34) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:56.311219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:56.314164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:56.326259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 125/250] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:56 2022] GET /identity/v3/role_assignments?user.id=69746daa19474ed9ae822b04a1332e34&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3ecff949085e494898251029e6bc12d4 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:56.327163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:56.384964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 126/251] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:49:56.466678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:56.713363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25539e-e5b3-4bc0-92df-f2f662f77437 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:56.774904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:56.833830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead526a-5285-4ad6-be41-29e8acb7ef1d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:56.849582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:56.850273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:56.850556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:56.850833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:56.851595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:56.851898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:56.853494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:56.871574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:56.872708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:56.881483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:56.908954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:56.910768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:56.911500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:56.912307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:56.935285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:56.953036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:56.954740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:49:56.956274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:49:56.961450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 127/253] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:49:56.970783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:57.267830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6794cb-8399-4276-98be-f7b3ac431961 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:57.364782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79a75-0503-4972-87b4-8923dd612d89 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:57.386190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:57.387549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.388066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.388532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] PATH_INFO: `/v3/users/970619a2247d46c6bec254bb9dc279ea` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.392067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] RBAC: Authorizing `identity:get_user(user_id=970619a2247d46c6bec254bb9dc279ea)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:57.394488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc46412-2c49-4906-a3f4-5a79cd0ac17f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:57.397934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 127/254] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:56 2022] GET /identity/v3/users/970619a2247d46c6bec254bb9dc279ea => generated 297 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:57.406145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775baf0-a6b4-4e20-9c23-e9ed40fbde90 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.408447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775baf0-a6b4-4e20-9c23-e9ed40fbde90 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.409487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775baf0-a6b4-4e20-9c23-e9ed40fbde90 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.412589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 128/255] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:49:57.415894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775baf0-a6b4-4e20-9c23-e9ed40fbde90 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:57.456362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:57.458778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.459493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.459977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.461978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:57.462706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:57.465740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350cc0f-5317-4abe-bf8a-9cb65a36278c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:57.484459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 128/256] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:57.486234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.486759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.487225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.514938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:49:57.516560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:49:57.556970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:57.568543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:57.652248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 129/257] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:49:57.654129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:57.734648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775baf0-a6b4-4e20-9c23-e9ed40fbde90 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:57.836279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:57.838912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.845801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.846851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.853241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:57.856569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:57.865337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 129/258] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:57 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:57.867726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:57.920061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854d07-2d56-4ae3-9876-49b6a9c437ac None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:57.993372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:57.995912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:57.996618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:57.997532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:57.999929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:58.003183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:58.007047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 130/259] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:57 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:58.009502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:58.136933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:58.181350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d190521-a337-4c59-8c96-fc1fa7d66a86 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:58.224547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:58.299156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:58.300233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:58.300836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:58.301307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:58.335585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:49:58.350744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205967c7-e3e9-4da7-8d9f-84961e8acde7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:49:58.370020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:49:58.371729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:49:58.373318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:49:58.377357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 130/260] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:49:58.378927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:58.482723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:58.488334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:58.488931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:58.489372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/970619a2247d46c6bec254bb9dc279ea/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:58.493099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, user_id=970619a2247d46c6bec254bb9dc279ea, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:58.495819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:58.557141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 131/261] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:49:58 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/970619a2247d46c6bec254bb9dc279ea/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:49:58.558627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:58.623734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1b2e-fc45-4d57-ba2f-9997a8e5d694 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:58.726851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:58.728038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:58.728529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:58.729023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:58.853755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:58.865121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67969525-d713-4170-829c-3a23d8f80435 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:58.890767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:58.977409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:58.979519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:58.979972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:58.980453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:58.982603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:58.983159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:58.985733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:58.985971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:58.988440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:59.015705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 132/262] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:59.022379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:59.193087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545417-ac23-4eac-a46e-ae4eeee1ed2c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:59.240499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 131/263] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:49:59.241586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:59.308393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:59.310167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.310666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.311162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] PATH_INFO: `/v3/users/b15539a2f2f34eada48b968580e5f4ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:59.317204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=b15539a2f2f34eada48b968580e5f4ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:59.320278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:59.323672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 133/264] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:49:59 2022] GET /identity/v3/users/b15539a2f2f34eada48b968580e5f4ae => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:49:59.337793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:59.383171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:59.414367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219f297-b8ff-4633-b2b5-583099b4a8cb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:59.446944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:49:59.456805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:59.457745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.458027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.458307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:59.461054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:59.462651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:59.465585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 132/265] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:49:59 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:59.477487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:49:59.698508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2acfb0-9c5c-4a77-a419-621cd213f3b6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:59.763766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536c55b-a42b-4538-9874-2b2033779978 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:49:59.803136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:59.804237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.804692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.805165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:59.838965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:49:59.840268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.840583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.841412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:59.844608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=b15539a2f2f34eada48b968580e5f4ae) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:49:59.845161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:49:59.847940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bebd5-2de5-4368-987e-a3a00955b7d6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:49:59.886171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 133/266] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:49:59 2022] GET /identity/v3/role_assignments?user.id=b15539a2f2f34eada48b968580e5f4ae&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:49:59.987790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47628-061b-4b90-a15d-070542a9e4a4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.988242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47628-061b-4b90-a15d-070542a9e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.988765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47628-061b-4b90-a15d-070542a9e4a4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:49:59.991488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 134/267] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:49:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:49:59.997661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd296-52c5-4dc4-9e95-70178cdff56a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:49:59.997978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd296-52c5-4dc4-9e95-70178cdff56a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:49:59.998203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd296-52c5-4dc4-9e95-70178cdff56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.013524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.020796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3d2bd296-52c5-4dc4-9e95-70178cdff56a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:00.022731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3d2bd296-52c5-4dc4-9e95-70178cdff56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:00.054921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:00.056698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:00.143025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.158509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 135/268] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:00.167930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74df5-75a7-4cb3-9bb0-a46a5ff67db8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.168647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74df5-75a7-4cb3-9bb0-a46a5ff67db8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.169138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74df5-75a7-4cb3-9bb0-a46a5ff67db8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.170922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 136/269] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:00.180430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.181070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.181742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.214286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:00.216424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:00.323642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 134/270] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 987 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:00.325269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:00.419902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 137/271] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:00.421542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:00.545731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a26d2-386b-42ed-811b-80052a9ae574 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:00.588638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.599026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.605300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:00.606530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.607011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.609701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.626388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:00.635653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:00.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:00.637496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:00.640164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 135/272] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:00.641301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:00.671981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb605e52-6e15-4489-8bbc-b397c94feb5b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:00.753218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:00.754119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.754385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.754660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.756054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:00.758447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:00.760965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 138/273] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:00 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:00.761911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:00.790230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5fa6-7de6-4829-b83a-25b44b194a48 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:00.830819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:00.832958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.833621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.834096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.835700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:00.837632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:00.839892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 136/274] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:00.841338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:00.914479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.920992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488961-8dff-4a2a-91cd-b73b36eabcfb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:00.971456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:00.972923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:00.973347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:00.973757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:00.974940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:00.975414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:00.977790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:00.978118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559ef-3d1b-4b02-9781-e826c69b80b1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:00.980167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:00.990293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 139/275] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:00.991148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:01.039604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:01.040748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.041211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.041693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.043338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=b15539a2f2f34eada48b968580e5f4ae) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:01.043760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:01.048340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae9ac-680c-42f2-88a8-b58d909a44e1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:01.055531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 137/276] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:00 2022] GET /identity/v3/role_assignments?user.id=b15539a2f2f34eada48b968580e5f4ae&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:01.059026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b8-a0aa-4e35-98cd-6bfeb51e51ec None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.059710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b8-a0aa-4e35-98cd-6bfeb51e51ec None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.060357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b8-a0aa-4e35-98cd-6bfeb51e51ec None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.062958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 138/277] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:01.064576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac0b8-a0aa-4e35-98cd-6bfeb51e51ec None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:01.196443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8f6c-825d-421e-8c09-45c50ec60f8d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:01.283394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:01.284892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.285367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac0b8-a0aa-4e35-98cd-6bfeb51e51ec None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:01.285571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.286056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.287401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:01.290497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09e47-8a88-4cf1-9564-6e012649ba83 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:01.311619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:01.333747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 140/278] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:00 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:01.337034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.337654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.338441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.342473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:01.344534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.345284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.345951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] PATH_INFO: `/v3/users/5a3411e151ed44fb818b3248866bc075` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.373117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:01.380117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:01.394222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] RBAC: Authorizing `identity:get_user(user_id=5a3411e151ed44fb818b3248866bc075)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:01.397263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:01.405351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 139/279] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:01 2022] GET /identity/v3/users/5a3411e151ed44fb818b3248866bc075 => generated 293 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:01.414097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:01.486784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:01.533062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 141/280] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:01.574175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:01.671565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585bd2e-2199-43ce-abcc-471ad048fe99 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:01.749078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:01.750160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.750614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.754119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.756681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, user.id=5a3411e151ed44fb818b3248866bc075, scope.system=all) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:01.757183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:01.760754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:01.773476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 6 20:50:01 2022] GET /identity/v3/role_assignments?user.id=5a3411e151ed44fb818b3248866bc075&scope.system=all&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 226 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:01.822189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389cda8-0fab-4d18-a24c-fda6dda859e0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:01.891665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:01.893105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:01.893418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:01.896027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:01.913768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e8c3855a-ebfd-479e-9d53-21ad4831eb58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:01.927746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:01.929304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:01.930247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 142/282] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:01.939062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:02.041119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:02.162935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9abb-6bd1-4acb-9be8-dcb82c43cc96 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.163355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9abb-6bd1-4acb-9be8-dcb82c43cc96 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.163534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca9abb-6bd1-4acb-9be8-dcb82c43cc96 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.166616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 143/283] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:02.172336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.172730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.172900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.186446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd9eea-e5e7-4c2b-b906-049ee410d607 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:02.208237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:02.210279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:02.235597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:02.240230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.240800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.241277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.244385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:02.244966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:02.247770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:02.272332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 141/284] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:02.280986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:02.296778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:02.369212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 144/285] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:02.407861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:02.544885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c7ab-ab85-45e0-891d-45896e0c52d0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:02.548395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:02.585762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2617-259b-430d-8d18-82e15b454fba None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:02.620220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:02.621816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.622300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.622801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] PATH_INFO: `/v3/users/69746daa19474ed9ae822b04a1332e34` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.625055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] RBAC: Authorizing `identity:get_user(user_id=69746daa19474ed9ae822b04a1332e34)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:02.627779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:02.632010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 142/286] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:02 2022] GET /identity/v3/users/69746daa19474ed9ae822b04a1332e34 => generated 297 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:02.639826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:02.693257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:02.694961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.695617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.696202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.741049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:02.760628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:02.761579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:02.762369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:02.762988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 145/287] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:02.768561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:02.856391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:02.907019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08609a-d3b8-4f35-8655-08b4c72d5515 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:02.979276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:02.980815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:02.981526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:02.982194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:02.984228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:02.987363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:02.991072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 143/288] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:02 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:02.999417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:03.108321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee688d-6096-4334-8c57-d1d769a335c2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:03.146589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:03.180780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:03.181489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:03.181771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:03.182051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:03.182821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:03.183130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:03.184579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:03.211451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 146/289] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:03.221104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:03.270978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a47c-f4be-4644-b3fe-7a34f6bef573 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:03.357174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:03.358652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:03.359032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:03.359487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/69746daa19474ed9ae822b04a1332e34/roles/3ecff949085e494898251029e6bc12d4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:03.363023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, user_id=69746daa19474ed9ae822b04a1332e34, role_id=3ecff949085e494898251029e6bc12d4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:03.365373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:03.423236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 144/290] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:50:02 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/users/69746daa19474ed9ae822b04a1332e34/roles/3ecff949085e494898251029e6bc12d4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:03.470024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:03.485493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684b949-900b-4c4d-8465-26c093744785 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:03.556023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:03.557633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:03.558125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:03.558612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] PATH_INFO: `/v3/users/970619a2247d46c6bec254bb9dc279ea` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:03.563534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] RBAC: Authorizing `identity:get_user(user_id=970619a2247d46c6bec254bb9dc279ea)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:03.567068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:03.570854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 147/291] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:03 2022] GET /identity/v3/users/970619a2247d46c6bec254bb9dc279ea => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:03.576454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:03.743225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:03.748515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da89f-0acb-488a-84d0-093bcbaf20b3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:03.797948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:03.798620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:03.798908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:03.799183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:03.946274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:03.949436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:04.194163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:04.204957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 145/292] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:04.210825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:04.400317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2acd7-81ca-4fac-bffb-f77b872359fe None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:04.468254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:04.469987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:04.470688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:04.471376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:04.474136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:04.477057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653049-b170-4978-9c68-52531db8b016 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:04.480753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 148/293] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:04 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:04.488026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:04.634541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4042-face-48df-a1c4-519ed635e7dc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:04.693263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:04.694286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:04.694725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:04.695220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:04.696357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=970619a2247d46c6bec254bb9dc279ea) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:04.696864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:04.698938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dedeff-e3da-4ad5-90fe-972223025f8a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:04.712102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 146/294] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:04 2022] GET /identity/v3/role_assignments?user.id=970619a2247d46c6bec254bb9dc279ea&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:04.918686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c903f5-bfda-4208-bca0-b86755b982b6 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:04.919431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c903f5-bfda-4208-bca0-b86755b982b6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:04.919940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c903f5-bfda-4208-bca0-b86755b982b6 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:04.922051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 149/295] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:04.928188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:04.928827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:04.929320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:04.951281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:04.957621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:05.063136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:05.077740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 147/296] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:05.102220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c903f5-bfda-4208-bca0-b86755b982b6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:05.142682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:05.228060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c903f5-bfda-4208-bca0-b86755b982b6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:05.267852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:05.269370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.269861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.270274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.282292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:05.291209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:05.292370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:05.293356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:05.295752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 150/297] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:05.305662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:05.445548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbde9c1-2eb3-492e-b0b2-d15f3443e5b2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:05.487615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:05.490363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.491749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.492279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.493274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:05.493727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:05.495297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef70d8-6bea-4757-924f-58711abf44cb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:05.506842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 148/298] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:05.512239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:05.548221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319c7e-c41f-4601-8214-f8c35ddbbe71 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.548925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319c7e-c41f-4601-8214-f8c35ddbbe71 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.549928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319c7e-c41f-4601-8214-f8c35ddbbe71 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.553336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 149/299] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:05.563423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.564550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.565303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.595162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:05.598011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:05.676512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:05.678450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:05.682795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657fc42-2060-42ca-840a-8923b83c4c26 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:05.716202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 150/300] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:05.726797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:05.727729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.728088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.728376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] PATH_INFO: `/v3/users/5a3411e151ed44fb818b3248866bc075` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.729712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] RBAC: Authorizing `identity:get_user(user_id=5a3411e151ed44fb818b3248866bc075)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:05.731270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:05.733473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 151/301] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:05 2022] GET /identity/v3/users/5a3411e151ed44fb818b3248866bc075 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:05.739106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:05.750571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:05.891754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea005a-864a-46e7-9edc-d3385a887f68 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:05.939047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:05.940592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:05.940881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:05.941250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] PATH_INFO: `/v3/system/users/5a3411e151ed44fb818b3248866bc075/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:05.942849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5a3411e151ed44fb818b3248866bc075, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:05.944398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:05.949812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3e4-6172-4471-9cdd-a9181cc9ed33 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:05.955290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 151/302] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Jun 6 20:50:05 2022] PUT /identity/v3/system/users/5a3411e151ed44fb818b3248866bc075/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:06.011738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.012611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.012898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.013179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.026778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-964de0bf-86ad-4cb8-a077-ca42382c7794 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:06.034977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:06.035971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:06.036812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:06.037412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 152/303] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:06.047203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:06.073717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d561e-6131-4ed9-ab49-f2cfdd799c6f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.074045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d561e-6131-4ed9-ab49-f2cfdd799c6f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.074452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d561e-6131-4ed9-ab49-f2cfdd799c6f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.076038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 153/304] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:06.082914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.083281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.083556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.102672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:06.103931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:06.123845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:06.138375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:06.211485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 154/305] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:06.221689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14835a27-6eb5-4bb4-b6ea-5908adf99b5c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:06.245179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:06.275393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.277029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.277839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.278338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:06.281748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:06.285952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:06.303547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 152/306] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:06.310404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:06.410688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b6c4-f710-4393-882a-bcea7874ada6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:06.447377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691980-3a90-4211-bc9a-cb9da4f04a1a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:06.460477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:06.474292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.475464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.475923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.476429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.478369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:06.480988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:06.488171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 155/307] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:06.492106 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:06.492478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.493964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.494457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.494872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] PATH_INFO: `/v3/users/39cbf1335a9c4da49745d86deedaa920` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.511779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] RBAC: Authorizing `identity:get_user(user_id=39cbf1335a9c4da49745d86deedaa920)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:06.513654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:06.520034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 153/308] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:06 2022] GET /identity/v3/users/39cbf1335a9c4da49745d86deedaa920 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:06.522477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:06.543709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:06.649726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd3341-bd92-47d3-8005-46ab8f50a7fb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:06.652385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cf83-56f4-46e5-8727-4b0e6ba308d2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:06.695199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.695979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.696306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.696617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] PATH_INFO: `/v3/groups` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.697358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:06.698982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8a34-c12d-4ef0-a793-c956d44a3b20 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:06.722338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 156/309] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Jun 6 20:50:06 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:50:06.725298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:06.726074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.726393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.726781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.727758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, user.id=39cbf1335a9c4da49745d86deedaa920, scope.system=all) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:06.732034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:06.732034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cdd31-45c2-48b7-920e-a7e9cb49df20 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:06.737003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 154/310] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 6 20:50:06 2022] GET /identity/v3/role_assignments?user.id=39cbf1335a9c4da49745d86deedaa920&scope.system=all&role.id=3ecff949085e494898251029e6bc12d4 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:06.781580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8a1f-fae9-43c3-a338-6cd3a8ca609e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.781955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8a1f-fae9-43c3-a338-6cd3a8ca609e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.782130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8a1f-fae9-43c3-a338-6cd3a8ca609e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.783982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 157/311] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:06.790284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:06.790615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:06.790838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:06.812651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:06.814813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:06.869704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:06.956281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 155/312] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:06.980465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8a1f-fae9-43c3-a338-6cd3a8ca609e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:07.113203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:07.135496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8a1f-fae9-43c3-a338-6cd3a8ca609e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:07.181368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:07.182573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:07.182914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:07.183251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:07.203873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:07.218682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:07.219647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:07.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 158/313] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:07.226498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:07.352124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad81f-2025-4d44-a6bb-30d52272c36d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:07.400498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:07.401554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:07.402024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:07.402491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:07.403464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:07.403951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:07.405593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:07.417200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 156/314] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:07.422612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:07.568874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd050a-ff9e-48f7-ad4c-2bb6f5dab8c9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:07.608558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:07.609461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:07.609746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:07.610026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] PATH_INFO: `/v3/users/69746daa19474ed9ae822b04a1332e34` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:07.611277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] RBAC: Authorizing `identity:get_user(user_id=69746daa19474ed9ae822b04a1332e34)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:07.613569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:07.615327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 159/315] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:07 2022] GET /identity/v3/users/69746daa19474ed9ae822b04a1332e34 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:07.621235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:07.656127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:07.753624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9be3fa-fc97-4434-a618-243225022405 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:07.793832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:07.794524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:07.794804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:07.795077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:07.883873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:07.885399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:07.911659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:07.996111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 157/316] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:07.997873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:08.001894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:08.116686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22a21-12cb-40c4-bc34-8d70f7634865 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:08.153174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:08.154094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:08.154373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:08.154618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:08.155868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:08.157376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e5a68-31ce-4a6c-bd0b-a48784ae44a3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:08.159634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 160/317] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:07 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:08.165784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:08.274429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15ff82-1d8f-4c49-a407-5e97bccb94e2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:08.321018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:08.325187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:08.325674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:08.325947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:08.326261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:08.327076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, scope.project.id=5d71c5e25f914eddb0620c392ae43241, user.id=69746daa19474ed9ae822b04a1332e34) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:08.327728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:08.329328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3653c6-b0b8-401f-9255-f450446f3c06 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:08.344216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 158/318] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:08 2022] GET /identity/v3/role_assignments?user.id=69746daa19474ed9ae822b04a1332e34&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3ecff949085e494898251029e6bc12d4 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:08.902381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08eaf9-ae81-4334-906a-cd995aa60479 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:08.903943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08eaf9-ae81-4334-906a-cd995aa60479 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:08.904638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08eaf9-ae81-4334-906a-cd995aa60479 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:08.909659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 161/319] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:08.919453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cd1e1-66f7-428b-a6f2-bd7219e35243 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:08.920499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cd1e1-66f7-428b-a6f2-bd7219e35243 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:08.920747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cd1e1-66f7-428b-a6f2-bd7219e35243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:08.940797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a32cd1e1-66f7-428b-a6f2-bd7219e35243 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:08.942232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a32cd1e1-66f7-428b-a6f2-bd7219e35243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:09.023805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 159/320] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:09.048279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08eaf9-ae81-4334-906a-cd995aa60479 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.133813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.168022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08eaf9-ae81-4334-906a-cd995aa60479 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.204800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.205666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.206019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.206390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.210435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5fa8-d7ce-4326-8594-801e81d4cac5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.210795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5fa8-d7ce-4326-8594-801e81d4cac5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.211138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5fa8-d7ce-4326-8594-801e81d4cac5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.212635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 160/321] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:09.218829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.218988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:09.219179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.219435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:09.227343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:09.228353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:09.229138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 162/322] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:09.235903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.242916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:09.244282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:09.325993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 161/323] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:09.347642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635e1d-9252-4127-af74-ab73018f725a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.349895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.380638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.386379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.387146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.387659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.387931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.388728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:09.389032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:09.390423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a47c9-e960-4e0e-af19-dcd8ebcc393c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:09.399486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 163/324] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:09.400934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be039b-97a6-46d5-8126-60dab915ee0d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.401226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be039b-97a6-46d5-8126-60dab915ee0d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.401496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be039b-97a6-46d5-8126-60dab915ee0d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.402738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 164/325] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:09.403400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.405289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be039b-97a6-46d5-8126-60dab915ee0d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.471003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fbc51-f79b-45c0-bf2c-7fa7d6996228 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.507744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.508707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.509063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.509393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.510682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:09.512374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a74e6-8fa3-4fb4-8a0b-3af3c9c1739a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:09.522111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 162/326] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:09.522111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.522111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.522111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.525015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be039b-97a6-46d5-8126-60dab915ee0d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.541196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:09.542443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:09.566059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.567055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.567346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.567618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] PATH_INFO: `/v3/users/5a3411e151ed44fb818b3248866bc075` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.568938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] RBAC: Authorizing `identity:get_user(user_id=5a3411e151ed44fb818b3248866bc075)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:09.570474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:09.572195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 165/327] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/users/5a3411e151ed44fb818b3248866bc075 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:09.572964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.626202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 163/328] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:09.627538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.664182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.684837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.709300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84968f8-074c-4b05-b9b6-9923f22db30e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.747685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.748280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.748562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.748836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] PATH_INFO: `/v3/groups` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.749523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:09.750649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee666e9-f91e-4384-a0c5-b59d255b3cd9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.750967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:09.768307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 166/329] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Jun 6 20:50:09 2022] POST /identity/v3/groups => generated 226 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:09.769734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:09.793029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:09.793790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:09.794124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:09.794468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:09.795492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] RBAC: Adding query filter params (role.id=4ed191822ab745e79a1e8158b3c6779b, user.id=5a3411e151ed44fb818b3248866bc075, scope.system=all) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:09.795891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:09.798239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:09.816590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 164/330] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/role_assignments?user.id=5a3411e151ed44fb818b3248866bc075&scope.system=all&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:09.950150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828e0bb-dda8-43fb-8be6-03294bd2f177 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:09.981258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:09.999751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:10.001001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:10.001479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:10.001952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:10.018353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:10.029367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:10.031065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:10.032562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 167/331] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:10.040591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:10.171411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b87c-7c4f-4bf5-8f54-5e4b356893ca None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:10.174116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:10.217980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:10.218924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:10.219381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:10.219799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:10.220819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:10.221144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:10.222756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:10.232901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 165/332] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:10.239554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:10.412729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8b8ca-9f1d-41f9-bfbf-893968f2d669 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:10.471409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:10.472699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:10.472984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:10.473260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] PATH_INFO: `/v3/users/39cbf1335a9c4da49745d86deedaa920` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:10.475663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] RBAC: Authorizing `identity:get_user(user_id=39cbf1335a9c4da49745d86deedaa920)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:10.477326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681912-2dad-4371-8dfb-38aec652c980 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:10.479223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 168/333] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:10 2022] GET /identity/v3/users/39cbf1335a9c4da49745d86deedaa920 => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:10.485089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:10.667865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e4c76-2c2b-464f-b240-ebd2317a6912 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:10.736222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:10.737800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:10.738276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:10.738749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] PATH_INFO: `/v3/system/users/39cbf1335a9c4da49745d86deedaa920/roles/3ecff949085e494898251029e6bc12d4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:10.741491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39cbf1335a9c4da49745d86deedaa920, role_id=3ecff949085e494898251029e6bc12d4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:10.744068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8766a-bef6-451c-926f-1adc18d469ab None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:10.763365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 166/334] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Jun 6 20:50:10 2022] PUT /identity/v3/system/users/39cbf1335a9c4da49745d86deedaa920/roles/3ecff949085e494898251029e6bc12d4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:50:14.296194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b15a9-229e-4bcb-a125-7f26965af7f8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.297878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b15a9-229e-4bcb-a125-7f26965af7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.298668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b15a9-229e-4bcb-a125-7f26965af7f8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.303568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 169/335] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:14.308142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e990e-6748-4cc4-8c83-3a1380dead96 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.308896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e990e-6748-4cc4-8c83-3a1380dead96 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.308896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e990e-6748-4cc4-8c83-3a1380dead96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.331721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-542e990e-6748-4cc4-8c83-3a1380dead96 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:14.333068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-542e990e-6748-4cc4-8c83-3a1380dead96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:14.359637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5afb-8ef2-429f-9d09-f235ac85d2eb None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.360679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5afb-8ef2-429f-9d09-f235ac85d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.361724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5afb-8ef2-429f-9d09-f235ac85d2eb None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.372123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 170/336] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:14.375388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.376541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.377319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.382095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:14.407604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:14.409832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:14.496512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:14.529728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 167/337] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:14.532056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5226-b458-4097-8631-75d680bd1202 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.534964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5226-b458-4097-8631-75d680bd1202 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.535521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5226-b458-4097-8631-75d680bd1202 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.538957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 168/338] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:14.550532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.550855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.551094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.559758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 171/339] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:14.581149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:14.582526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:14.593348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:14.685247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 169/340] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:14.688796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:14.818738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:14.839624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca7bbe-6255-40cf-8260-b267b3bbaaab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:14.852139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50727164-d200-4df2-97e1-c9b0c60c901b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:14.892470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:14.893831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.894306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.894764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.904882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:14.905756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:14.906041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:14.906324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:14.908138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:14.916313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:14.917265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 20:50:14.918048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:14.920827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 172/341] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:14.921896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:14.926366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:14.942499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:14.943470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 170/342] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:14.949091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.009588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:15.119633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fadfa6-59ab-4b08-9b0a-603aac1bc06a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.163882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3d72-c961-471a-989e-0e34d0091f08 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.166161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.167311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.167601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.167874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.185941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:15.196174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:15.197347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:15.198330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:15.201110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 173/343] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:15.202234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.236080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.237806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.238229 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.238668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.239582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:15.240688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:15.242845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605ef8-bf6b-485f-8a59-4b3671ed449e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:15.253911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 171/344] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:15.256314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad2df-16c0-401d-8734-5c1542cf634e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.256938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad2df-16c0-401d-8734-5c1542cf634e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.257349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad2df-16c0-401d-8734-5c1542cf634e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.259295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 172/345] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:15.260205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad2df-16c0-401d-8734-5c1542cf634e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.277282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:15.418600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad2df-16c0-401d-8734-5c1542cf634e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.428694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:15.432996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f689-fca4-42c1-abd0-65a291db5cc0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.490985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.492150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.492661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.493072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.494124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:15.494569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:15.494912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.496587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.496700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.497139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb128da3-6209-4305-aa97-de92e261eb8a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:15.497398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.498876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:15.499573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:15.502258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:15.508189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 174/346] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:15.509726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.510152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.510559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.529069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 173/347] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:15.529796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:15.530834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.531286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:15.626905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 175/348] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:15.627952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.673309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:15.705894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef2863-f15f-4dc2-9f18-d455b111add1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.759679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.760786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.761221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.761658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] PATH_INFO: `/v3/users/39cbf1335a9c4da49745d86deedaa920` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.763584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] RBAC: Authorizing `identity:get_user(user_id=39cbf1335a9c4da49745d86deedaa920)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:15.764682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:15.765158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:15.767397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 174/349] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:50:15 2022] GET /identity/v3/users/39cbf1335a9c4da49745d86deedaa920 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:15.767751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:15.780989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a60eb-b017-46fd-a0ed-36bb44beeb4c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.824916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.825592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.825893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.826131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.916929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8209c6-8baa-40e0-a8b0-239c753b5b9c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:15.923032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:15.924834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d160d-ba23-4a2c-a2cc-83ceda2a32a5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:15.970304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:15.970968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:15.971247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:15.971547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:15.984877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.069965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:16.072661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c07f72-3848-4b32-9567-ced79210a1d0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:16.078634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.096797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 176/350] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:16.098544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ac85-1e46-4138-90f3-de1a3183d04a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.099006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ac85-1e46-4138-90f3-de1a3183d04a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.099940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ac85-1e46-4138-90f3-de1a3183d04a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.103375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 177/351] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:16.104923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ac85-1e46-4138-90f3-de1a3183d04a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.233303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:16.235138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9938d-b7a2-4024-accf-45c867215b48 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.235497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9938d-b7a2-4024-accf-45c867215b48 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.235879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9938d-b7a2-4024-accf-45c867215b48 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.238183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 176/353] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:16.239235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9938d-b7a2-4024-accf-45c867215b48 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.254707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ac85-1e46-4138-90f3-de1a3183d04a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:16.307086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.308396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:16.310786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.310927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.311344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.333066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:16.342099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:16.343047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:16.343839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 178/354] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:16.344549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.400278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9938d-b7a2-4024-accf-45c867215b48 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:16.422840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.453687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:16.454231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.454503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.454664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.455598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] RBAC: Adding query filter params (role.id=3ecff949085e494898251029e6bc12d4, user.id=39cbf1335a9c4da49745d86deedaa920, scope.system=all) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:16.455843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:16.458688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c14cb-af1c-4fa1-aba2-2b87c05ddc77 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:16.476876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 177/355] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/role_assignments?user.id=39cbf1335a9c4da49745d86deedaa920&scope.system=all&role.id=3ecff949085e494898251029e6bc12d4 => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:16.478337 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d650d6-6df4-489c-a259-e405d5fc9688 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.478720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d650d6-6df4-489c-a259-e405d5fc9688 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.480106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d650d6-6df4-489c-a259-e405d5fc9688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.505382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cb0ef-6ac5-4797-89c5-79c4a9c91273 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:16.506440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-15d650d6-6df4-489c-a259-e405d5fc9688 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:16.509425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-15d650d6-6df4-489c-a259-e405d5fc9688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:16.575858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:16.576820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.577107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.577378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.579475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:16.581217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:16.584455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 179/356] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:16.585347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.632072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 178/357] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:16.633738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.634187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.634573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.671516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:16.673646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:16.725261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.764096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2bfd-8b06-4402-96d6-f73d52e05f35 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:16.788621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 179/358] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:16.789499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.802621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:16.825714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:16.827246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:16.827246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:16.827524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:16.829076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:16.831836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:16.833748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 180/359] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:16.834728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:16.947851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aeac7-1155-4208-a45e-2dcf2b6bfaa3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:16.974271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feed020-51ea-4ab6-8895-f84948c7fcc1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.007761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.008788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.009250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.009692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.010927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:17.011433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.013875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.023949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.025490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.025774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.026031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.029141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 180/360] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.030537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.034881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.042957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.042957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 181/361] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:16 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.042957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.071491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.128606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.175393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a6f9-a9cd-4509-b273-0e40b50d750f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.200270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074226a-f2cf-4752-804c-c4998da22603 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.224312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.228307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.228307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.228307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.241895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.242557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.242848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.243018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:17.243112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:17.256409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:17.257385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:17.258189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:17.258796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 181/362] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:17.259644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.265496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:17.276402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:17.278042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 182/363] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:17.279529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.385761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.400598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babca057-58e6-40ec-a84f-fc85ad273730 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.411573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec29a9-501d-4754-bee8-9e223da0483b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.414846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.440580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.441496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.441880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.442243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.453527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.454941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.455522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.455905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.458000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.460535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.463198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 182/364] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.464666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.540329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.541840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.601814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4b0-1d89-4bdd-ade3-b968a5fb098a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.648584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.649596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.650059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.650388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.651784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=0eb8c20d86434284896d07505a3ce80c) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:17.652286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.654817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.676027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 183/365] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.676027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.685055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 183/366] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:17.687160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.692691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.709905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:17.835044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3b141-119c-45fd-835e-5dd57f588db4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.868539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5fd19-1726-4b47-b794-9459558367fd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:17.887275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.888143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.888521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.888809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.889624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:17.889933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.891392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.900946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 184/367] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.901738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:17.931386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:17.932514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:17.933191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:17.933481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:17.934898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:17.935357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:17.937966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:17.952921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 184/368] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:17.954165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.014484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.056934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533204b-fdac-4122-9891-cc74c8ab7546 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.092979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.115667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.116852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.117352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.117850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.119476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=0eb8c20d86434284896d07505a3ce80c) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:18.119932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.122763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.124709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dd561-4c4b-4a77-bb51-a7c6c4537a4f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.130786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 185/369] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:18.131916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.193468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.194893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.195379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.195851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.197552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.199447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.202198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 185/370] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:17 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:18.203504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.259927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeac16-72cc-4965-8568-9c1087e0ed52 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.300596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.301239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.301524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.301797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.315041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.341370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85c5a-e90a-402d-a08d-79cfc736eaad None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.382020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.383894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.393755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.394713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.395160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.396230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.432114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.516044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 186/371] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:18.516044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.548831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.551584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.570044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.672695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4678b-7407-4170-aa60-26d68d3553fa None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.684669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 186/372] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:18.686411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.722172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.723635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.724229 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.724827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.726533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.728967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.731061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 187/373] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:18.732118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.750823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.823691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ab6cb-e003-4ec7-bcc0-9c36202a2d42 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.866963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.867910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.868247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.868492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] PATH_INFO: `/v3/projects/975471a492db48b49b1c3d1741da2fcb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.870061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=975471a492db48b49b1c3d1741da2fcb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.871609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.876146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 187/374] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/projects/975471a492db48b49b1c3d1741da2fcb => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:18.878091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:18.905450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee15da-7188-4893-b5a3-d8457186ea88 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:18.921574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:18.956044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:18.957557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:18.958144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:18.958725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:18.960676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:18.962638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:18.965113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 188/375] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:18.966616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:19.045742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65da99-2fa9-4a65-86c5-254613919ef7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:19.059652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:19.088551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:19.089885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:19.090163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:19.090436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:19.091699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=5d71c5e25f914eddb0620c392ae43241) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:19.092024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:19.093819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:19.101273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 188/376] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:19.102120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:19.175975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13eeb2-2c0a-4362-aade-1f02e7530006 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:19.251155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:19.253913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:19.255508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:19.256033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] PATH_INFO: `/v3/groups/4f8acc7e0c05424ab1b3def6c223084d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:19.265698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] RBAC: Authorizing `identity:get_group(group_id=4f8acc7e0c05424ab1b3def6c223084d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:19.267767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:19.271150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 189/377] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:18 2022] GET /identity/v3/groups/4f8acc7e0c05424ab1b3def6c223084d => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:19.277247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:19.367501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:19.401705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d832e-2eaa-4d5c-8870-2fc89badd346 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:19.491748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:19.493313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:19.493819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:19.494316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:19.501348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:19.509067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:19.512413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 189/378] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:19 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:19.520834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:19.533157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97660-1f42-4ff1-9001-62d540790f1e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:19.599877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:19.601015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:19.603758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:19.603758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:19.603758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] RBAC: Adding query filter params (group.id=4f8acc7e0c05424ab1b3def6c223084d, role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=975471a492db48b49b1c3d1741da2fcb) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:19.604278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:19.607035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bcac2-3874-43d2-af48-caa5141caedf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:19.618896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 190/379] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:19 2022] GET /identity/v3/role_assignments?group.id=4f8acc7e0c05424ab1b3def6c223084d&scope.project.id=975471a492db48b49b1c3d1741da2fcb&role.id=752ec01362414518a74fb7fe863f812e => generated 260 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:19.624623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:19.710494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41f89-accc-4fc7-9207-b2ecc7f03ac5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:19.766000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:19.768338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:19.768338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:19.768338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:19.768338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=5d71c5e25f914eddb0620c392ae43241) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:19.768855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:19.770134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33c206-564a-4b08-a388-8d0ad83319f7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:19.780974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 190/380] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:19 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:20.320344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582b2c-806e-4629-bf8e-2b0e663cea3f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:20.320522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582b2c-806e-4629-bf8e-2b0e663cea3f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:20.320793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582b2c-806e-4629-bf8e-2b0e663cea3f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:20.322475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 191/381] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:20.328262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:20.328549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:20.328824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:20.348729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:20.349935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:20.458068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 191/382] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:20.497534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582b2c-806e-4629-bf8e-2b0e663cea3f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:20.701910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582b2c-806e-4629-bf8e-2b0e663cea3f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:20.704574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:20.741427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:20.742336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:20.742627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:20.742903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:20.759408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4d94ec36-f200-452f-b137-c2f5adbdfe36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:20.771835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:20.772839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:20.774988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 192/383] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:20.782706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:20.850241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:20.885698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934392-27dd-4ec2-bcdf-76f64e259b1a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:20.886074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934392-27dd-4ec2-bcdf-76f64e259b1a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:20.886566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934392-27dd-4ec2-bcdf-76f64e259b1a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:20.891035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 193/384] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:20.894921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:20.895274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:20.895558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:20.933804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:20.935232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:20.971420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5ddf2-78f4-4204-99d7-8b40be3d30a3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:21.058051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 194/385] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:21.081107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.100118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:21.101142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:21.101573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:21.101991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:21.102931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:21.103499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:21.105215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:21.127660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 192/386] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:21.133986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.249159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:21.267594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ea128-2652-4501-9d4d-120ffaa439cb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:21.359051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:21.364193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:21.366222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:21.366222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:21.366222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:21.369521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725790-7aee-4331-8107-a6f614c46248 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:21.391867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:21.401828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:21.403531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:21.405070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 195/387] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:21.422057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.466258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:21.467641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:21.467926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:21.468251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:21.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:21.471027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:21.473949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 193/388] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:21 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:21.480472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.686192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe601a-1f4d-4a5f-a7f1-17ae3b92df94 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:21.712676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050f9d-92e0-405a-a10e-afe515898d92 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:21.777526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:21.778819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:21.779119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:21.779396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:21.781404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:21.782905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:21.786338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 194/389] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:21 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:21.794495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7731-e28e-439d-8051-e38511299859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:21.795227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7731-e28e-439d-8051-e38511299859 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:21.795511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7731-e28e-439d-8051-e38511299859 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:21.795795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7731-e28e-439d-8051-e38511299859 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:21.796607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7731-e28e-439d-8051-e38511299859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:21.796916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7731-e28e-439d-8051-e38511299859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:21.798385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7731-e28e-439d-8051-e38511299859 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:21.802570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.824502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 196/390] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:21.832163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7731-e28e-439d-8051-e38511299859 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:21.868714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:21.886114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:22.000725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935553fb-bbad-4fcc-8b69-14fd208c5e7e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:22.110206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:22.111605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.112156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.112588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.119251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, group_id=9ef860209bc641fb8df7e85ed3e00b7f, role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:22.121783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:22.140509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7731-e28e-439d-8051-e38511299859 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:22.156212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 195/391] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 6 20:50:21 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/3fac18083f284da8a654bbbc3a62d49b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:22.214532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:22.216468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.216934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.217411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.219798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:22.222799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7d4e-4ff7-4f2d-915e-c317e71ad46b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:22.226342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 197/392] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:21 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:22.236326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:22.282189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0801cc-2431-4a32-bb29-a7d883e561a4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.282582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0801cc-2431-4a32-bb29-a7d883e561a4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.283073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0801cc-2431-4a32-bb29-a7d883e561a4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.286655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 198/393] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:22.294042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.294517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.295021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.349323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:22.350603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:22.491883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 199/394] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:22.502323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:22.512285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cefca-8e33-446b-94e4-1e724cf6250b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:22.525432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:22.562378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:22.577722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:22.578921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.579346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.579758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.582064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:22.583754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:22.586237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 196/395] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:22 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:22.595796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:22.783906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bcdd5-d462-4788-ad53-bfbe07d4249c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:22.870172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:22.872646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:22.873288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:22.873935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:22.904329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:22.924045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:22.925857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:22.926754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:22.927368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2909b-7717-45ca-8978-95f14cf182c9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:22.927785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 200/396] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:22.928679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.001604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:23.003477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.003960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.008361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.012056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] RBAC: Authorizing `identity:create_grant(project_id=0eb8c20d86434284896d07505a3ce80c, group_id=9ef860209bc641fb8df7e85ed3e00b7f, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:23.014712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a769-bfe2-4da2-bc4e-1fde4b7bbc4c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:23.060691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 197/397] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 6 20:50:22 2022] PUT /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:50:23.111373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:23.167516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7fd7-a985-4466-a08f-1800fd146d34 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:23.180530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0dd6a-aa8d-4df2-9f91-a75d4cffddf0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.181471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0dd6a-aa8d-4df2-9f91-a75d4cffddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.182383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0dd6a-aa8d-4df2-9f91-a75d4cffddf0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.190813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 198/398] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:23.197535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c4d8-849b-41e6-8bf1-dd327f7c256a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.198388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c4d8-849b-41e6-8bf1-dd327f7c256a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.198972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c4d8-849b-41e6-8bf1-dd327f7c256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.243115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:23.244957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.245735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.246508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.249643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:23.250623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:23.254496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36057340-1af7-4e3c-af97-3d4a7642fd4c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:23.258556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-eb97c4d8-849b-41e6-8bf1-dd327f7c256a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:23.261488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eb97c4d8-849b-41e6-8bf1-dd327f7c256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:23.284310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 201/399] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:23.288080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b4d5-5939-4681-bf08-dfb79aeca564 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.288080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b4d5-5939-4681-bf08-dfb79aeca564 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.288080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b4d5-5939-4681-bf08-dfb79aeca564 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.290546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 202/400] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:23.294990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b4d5-5939-4681-bf08-dfb79aeca564 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.308833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:23.413967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 199/401] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:23.415974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.425581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.425581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.462850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:23.464175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:23.528395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b4d5-5939-4681-bf08-dfb79aeca564 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:23.571741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:23.572676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.572958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.573227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.574496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:23.575966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:23.577984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 203/402] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:23 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:23.578858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:23.607090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 200/403] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:23.607734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.721368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:23.773584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea406f-e452-4890-8df6-eb9d9d568c70 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:23.773864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff6fd-af5e-4dcf-8e2d-a2d68506b802 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:23.825043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:23.826177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.826706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.826987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.840118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:23.849754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:23.851431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:23.852972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:23.854137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:23.855150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:23.855150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:23.855595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:23.862126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 204/404] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:23.862126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.862732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:23.862732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:23.865989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 201/405] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:23 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:23.867739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:23.931931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:23.978318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9593-65cf-48a6-97ff-3ebf0bb4f48a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.021386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.022230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.022514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.022787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.042089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:24.055956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:24.057802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 205/406] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:24.059637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:24.089173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb242a-7679-4f3a-9866-4a279f91cb0f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.157573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.159524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.160297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.160955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.162643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:24.163625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:24.166600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:24.184264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 202/407] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:24.186113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:24.192399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be94eb0-641f-41a7-bd00-ed214c161c4f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.217843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:24.244506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:24.267774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.268459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.269670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.270134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.273909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, group_id=9ef860209bc641fb8df7e85ed3e00b7f, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:24.276682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:24.310067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 206/408] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 6 20:50:24 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:24.311963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:24.408849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189abcf-94ab-4826-94cb-c334d0f83416 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.502040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.506288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.507181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.509083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.511000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:24.512258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:24.519518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:24.542821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 203/409] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:24.548959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:24.580708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf14a-9966-4db7-88a0-7452c94834a9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.683098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.690322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.691501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.692296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.698451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:24.706293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:24.714909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 207/410] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:24 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:24.724707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:24.779411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:24.837798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487e3e-70f3-4694-95fd-3bb922ea30fd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:24.856560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:24.958237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:24.959951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:24.960490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:24.960960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] PATH_INFO: `/v3/groups/4f8acc7e0c05424ab1b3def6c223084d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:24.964259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] RBAC: Authorizing `identity:get_group(group_id=4f8acc7e0c05424ab1b3def6c223084d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:24.967338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:24.973366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 204/411] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:24 2022] GET /identity/v3/groups/4f8acc7e0c05424ab1b3def6c223084d => generated 229 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:24.977871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:25.028716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217fa69-19ca-436f-8a44-f0dc21525b70 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:25.115184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:25.117541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.118347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.119103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.122047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:25.125102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:25.130019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 208/412] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:24 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:25.144425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:25.280362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783e924-4a64-4f8a-aa45-0e2f51eb300f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:25.367740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d950da-f2bf-4845-9076-6fc5296a60bd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:25.368175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:25.368992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.369272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.369549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] PATH_INFO: `/v3/projects/975471a492db48b49b1c3d1741da2fcb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.372452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] RBAC: Authorizing `identity:get_project(project_id=975471a492db48b49b1c3d1741da2fcb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:25.373764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:25.375926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 205/413] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:24 2022] GET /identity/v3/projects/975471a492db48b49b1c3d1741da2fcb => generated 344 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:25.381702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:25.409929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:25.412156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:25.440052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:25.440052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.440052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.440052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.443829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] RBAC: Authorizing `identity:create_grant(project_id=5d71c5e25f914eddb0620c392ae43241, group_id=9ef860209bc641fb8df7e85ed3e00b7f, role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:25.444791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296eada-209c-4719-b53e-35c6f5b1026d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:25.474731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 209/414] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 6 20:50:25 2022] PUT /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241/groups/9ef860209bc641fb8df7e85ed3e00b7f/roles/3fac18083f284da8a654bbbc3a62d49b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:25.478390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f60f-79dc-4692-922c-1337f54107e5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.478848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f60f-79dc-4692-922c-1337f54107e5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.479304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f60f-79dc-4692-922c-1337f54107e5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.482837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 210/415] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:25.490400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.491013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.491487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.532789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:25.534995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:25.669320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82558e-fbe1-4cec-aee3-9a95ba4f9c6e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:25.751863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 211/416] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:25.758607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:25.759931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.760483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.760955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] PATH_INFO: `/v3/projects/975471a492db48b49b1c3d1741da2fcb/groups/4f8acc7e0c05424ab1b3def6c223084d/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.763377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=975471a492db48b49b1c3d1741da2fcb, group_id=4f8acc7e0c05424ab1b3def6c223084d, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:25.765264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:25.777495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:25.790981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 206/417] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Jun 6 20:50:25 2022] PUT /identity/v3/projects/975471a492db48b49b1c3d1741da2fcb/groups/4f8acc7e0c05424ab1b3def6c223084d/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:50:25.913419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e9368-0655-459d-b4c9-4c1166065c10 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:25.928480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:25.971664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:25.972958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:25.973438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:25.973919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:25.995407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:26.005500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:26.006484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:26.007290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:26.010270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 212/418] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:26.016147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:26.149563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:26.191921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c86e-ee01-4bd6-89e6-472638a423b0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:26.245815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:26.246539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:26.246815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:26.247094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:26.247892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:26.248268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:26.249726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:26.260652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 207/419] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:26.273228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:26.424286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba973b8e-12b6-4875-ba0b-e18bf9a49153 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:26.480350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:26.481385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:26.481876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:26.482352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:26.560541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:26.621035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:26.623867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:26.841649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 213/420] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:26.850947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:27.118898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f6917-b5b8-47e7-9ec8-4fea610f9049 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:27.192207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:27.201236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:27.202761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.203256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.203746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.206063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:27.208890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f816-36a1-4f5c-a4d3-a6c1ebb9897d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:27.212234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 208/421] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:26 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:27.221294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:27.311752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ad8d-3618-4e5b-a3d7-641430e55c31 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.312276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ad8d-3618-4e5b-a3d7-641430e55c31 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.312762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ad8d-3618-4e5b-a3d7-641430e55c31 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.315634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 209/422] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:27.327017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.327513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.328023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.360479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:27.375905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:27.378208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:27.380129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07b95f-1456-4eb3-b866-5d6fda2415b3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:27.416690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:27.417646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.417928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.418202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.419393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:27.420890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:27.422852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 214/423] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:27 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:27.432662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:27.511268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 210/424] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:27.546841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:27.637939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7525-4e47-40d0-b06c-1582530f0819 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:27.679624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:27.680726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.681225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.681695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.682732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=0eb8c20d86434284896d07505a3ce80c) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:27.683333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:27.685055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:27.692743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 215/425] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:27 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 611 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:27.740600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c17a-1932-4fb7-a40d-cd7cd23886cf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:27.774496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:27.782425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:27.783754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:27.784337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:27.784823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:27.797680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:27.806171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:27.807194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:27.808060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:27.810572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 211/426] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:27.823699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:27.827725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:27.978006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1515b6-a1c0-49fd-a678-b1c73f728b04 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:28.018366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:28.019433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.019860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.020304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.021235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:28.021684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:28.023263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:28.033217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 216/427] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:28.041152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:28.206741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f6cc-bfd8-488a-b12e-13f933702c99 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:28.248417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:28.249016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.249299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.249569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.323816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:28.333211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:28.334782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:28.461675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 212/428] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:28.467705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:28.537233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:28.579396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1209e-0d7d-4547-99a3-6964cbeefac3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:28.617320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:28.618218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.618497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.618768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] PATH_INFO: `/v3/projects/0eb8c20d86434284896d07505a3ce80c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.620071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] RBAC: Authorizing `identity:get_project(project_id=0eb8c20d86434284896d07505a3ce80c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:28.621548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:28.623619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 217/429] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:28 2022] GET /identity/v3/projects/0eb8c20d86434284896d07505a3ce80c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:28.630310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:28.740626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:28.750801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329fd57-055b-4d82-ae65-1fb5b43adffc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:28.793384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:28.794210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.794495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.794778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.796206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:28.797716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2a84-a812-4025-8d71-3966293ac3a1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:28.800077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 213/430] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:28 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:28.806409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:28.918035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22163a-a181-4064-b7c2-9bacc1ce7388 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:28.946933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871920b-023c-4b2e-8c06-3a64db38a995 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.947736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871920b-023c-4b2e-8c06-3a64db38a995 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.948236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871920b-023c-4b2e-8c06-3a64db38a995 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.950707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 214/431] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:28.956591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:28.961969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:28.962271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530b7b-0570-43bd-8248-5567b62f6f89 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.962684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:28.962993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.963305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.964041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530b7b-0570-43bd-8248-5567b62f6f89 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:28.964225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=0eb8c20d86434284896d07505a3ce80c) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:28.964550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:28.965484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530b7b-0570-43bd-8248-5567b62f6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:28.966484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:28.973814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 218/432] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:28 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=0eb8c20d86434284896d07505a3ce80c&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:28.998946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-14530b7b-0570-43bd-8248-5567b62f6f89 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:29.001715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-14530b7b-0570-43bd-8248-5567b62f6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:29.152210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 215/433] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:29.184093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.247724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b33c-86a5-4788-97f4-3d8ab83335b1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.248087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b33c-86a5-4788-97f4-3d8ab83335b1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.248396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b33c-86a5-4788-97f4-3d8ab83335b1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.250004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 216/434] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:29.255793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a097e-5625-4593-88f2-fb545a630726 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.256216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a097e-5625-4593-88f2-fb545a630726 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.256395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a097e-5625-4593-88f2-fb545a630726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.276774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0b1a097e-5625-4593-88f2-fb545a630726 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:29.278366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0b1a097e-5625-4593-88f2-fb545a630726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:29.319560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f75ddd-36b1-45e5-95cd-25e5e1971014 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:29.374256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:29.375247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.375541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.375819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.376919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 217/435] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:29.379010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6238d2-ea34-44c2-8e8a-5e817323d8be None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.379500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6238d2-ea34-44c2-8e8a-5e817323d8be None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.380044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6238d2-ea34-44c2-8e8a-5e817323d8be None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.382590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 218/436] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:29.391291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.391789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.392217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.395462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:29.406844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:29.408015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 20:50:29.409122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:29.409718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 219/437] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:29.410449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.423676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:29.425368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:29.441956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:29.491331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:29.537390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 219/438] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:29.540800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.563927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5a28-ac46-41e1-9c26-ffbb05f0737a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:29.634515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:29.636636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.636636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.636636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.654087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:29.670056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:29.671020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:29.671916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:29.672669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 220/439] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:29.676055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.798198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87843771-8b90-48a0-be99-4c04a69f1ff9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:29.799542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db573ad-e1bc-4cd6-8dbc-15c8a7f18951 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:29.816444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:29.836115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:29.836804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.837073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.837335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.838087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:29.838382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:29.839760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:29.842683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:29.843602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:29.843972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:29.844378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:29.849614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 220/440] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:29.850448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.858269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:29.865944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:29.866665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:29.867657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:29.868555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 221/441] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:29.869339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:29.981667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff262e-4155-4ae5-a654-9ea567852dfb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:29.995676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da00b-8e0b-42d8-9dde-541f770e5c36 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.018690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.019540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.019814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.020124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.020882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:30.021181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.022579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.032929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 221/442] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:30.033940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.040360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.041055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.041335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.041602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.094400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.123221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.124937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.128783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.173394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a27a58-8455-4abf-b8a8-94e392223967 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.214910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.215610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.216264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.216539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.217326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:30.217653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.219083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.236602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 222/443] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:30.236602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.254792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 222/444] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:30.255705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.350600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222c50-0c7b-4eaf-8280-63e75018e110 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.353069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.381804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307056e-7167-4b02-82d3-577783a436c8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.391194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.391860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.392180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.392453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.396042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.419311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.419972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.420285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.420672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.469013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.471983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.511655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.513223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.614822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 223/445] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:30.615982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.625772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.660186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 223/446] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:30.661674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.673523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.746428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af439-e551-44cb-977c-3653d0e5aa9d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.783846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.784662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.784943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.785213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.786476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.787754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1eff9-344b-450f-a3ad-4be9da0d6fd3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.787929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.789875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 224/447] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:30.790521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.835872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.836782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.837047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.837320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] PATH_INFO: `/v3/projects/5d71c5e25f914eddb0620c392ae43241` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.838597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] RBAC: Authorizing `identity:get_project(project_id=5d71c5e25f914eddb0620c392ae43241)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.840082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.842373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 224/448] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/projects/5d71c5e25f914eddb0620c392ae43241 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:30.843032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.891000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.919796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ce0d4-3239-4c84-a5dd-7abcdbc9c1f3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.921559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:30.955882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838609c7-641e-4a8e-914e-a1269afb9252 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:30.962115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.963243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:30.963696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:30.964154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] PATH_INFO: `/v3/projects/975471a492db48b49b1c3d1741da2fcb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:30.965714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] RBAC: Authorizing `identity:get_project(project_id=975471a492db48b49b1c3d1741da2fcb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:30.967711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:30.970001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 225/449] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/projects/975471a492db48b49b1c3d1741da2fcb => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:30.970943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:30.998887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:30.999754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.000053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.000325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.001545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.003325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.005028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 225/450] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:31.005896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:31.120457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf20449-ab8d-4c06-ab90-7d87caf57458 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:31.123255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1633f7a-4b40-432d-9e6f-ea7f0ebc0ebb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:31.138717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:31.170416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:31.171835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.172326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.172771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] PATH_INFO: `/v3/groups/4f8acc7e0c05424ab1b3def6c223084d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.174406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:31.174880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] RBAC: Authorizing `identity:get_group(group_id=4f8acc7e0c05424ab1b3def6c223084d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.175974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.176449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.177126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.177225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] PATH_INFO: `/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.179099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] RBAC: Authorizing `identity:get_group(group_id=9ef860209bc641fb8df7e85ed3e00b7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.187311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 226/451] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:31 2022] GET /identity/v3/groups/4f8acc7e0c05424ab1b3def6c223084d => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:31.187311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:31.187689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.187689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 226/452] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Jun 6 20:50:30 2022] GET /identity/v3/groups/9ef860209bc641fb8df7e85ed3e00b7f => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:31.188332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:31.236661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:31.321564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbcdd-5a8d-4671-bf05-1abf8568052e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:31.342303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f253cd-88bd-4d24-97ec-abf9fa5fe660 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:31.383507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:31.384632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.385130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.385461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.387019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] RBAC: Adding query filter params (group.id=4f8acc7e0c05424ab1b3def6c223084d, role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=975471a492db48b49b1c3d1741da2fcb) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:31.387523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.389933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.390777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:31.391452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.391717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.391984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.392889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=4ed191822ab745e79a1e8158b3c6779b, scope.project.id=5d71c5e25f914eddb0620c392ae43241) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:31.393186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.394804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e3db-ccd3-4925-aa83-86c21c296c9d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.412040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 227/453] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:31 2022] GET /identity/v3/role_assignments?group.id=4f8acc7e0c05424ab1b3def6c223084d&scope.project.id=975471a492db48b49b1c3d1741da2fcb&role.id=752ec01362414518a74fb7fe863f812e => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:31.412294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 227/454] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:31 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=4ed191822ab745e79a1e8158b3c6779b => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:31.412383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:31.576589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77142aa6-6866-4835-a98d-74dd4814c4c0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:31.579095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:31.630676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:31.631465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:31.631817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:31.632214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:31.633199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] RBAC: Adding query filter params (group.id=9ef860209bc641fb8df7e85ed3e00b7f, role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=5d71c5e25f914eddb0620c392ae43241) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:31.633579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:31.635232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042d931-9f79-43b4-a3f4-b53ec9d9574d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:31.643779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 228/455] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Jun 6 20:50:31 2022] GET /identity/v3/role_assignments?group.id=9ef860209bc641fb8df7e85ed3e00b7f&scope.project.id=5d71c5e25f914eddb0620c392ae43241&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:35.484619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4cee-534a-415b-a7c3-5a8de2eca3b8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:35.486291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4cee-534a-415b-a7c3-5a8de2eca3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:35.488363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4cee-534a-415b-a7c3-5a8de2eca3b8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:35.491416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 228/456] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:35.500245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f94872-a008-406d-b29b-60903db47600 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:35.501064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f94872-a008-406d-b29b-60903db47600 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:35.501064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f94872-a008-406d-b29b-60903db47600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:35.529839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-88f94872-a008-406d-b29b-60903db47600 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:35.531071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-88f94872-a008-406d-b29b-60903db47600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:35.717072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 229/457] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:35.761946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4cee-534a-415b-a7c3-5a8de2eca3b8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:35.852563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135fac-1828-4b6c-b88b-6f0daab585ce None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:35.853222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135fac-1828-4b6c-b88b-6f0daab585ce None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:35.853688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135fac-1828-4b6c-b88b-6f0daab585ce None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:35.855613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 230/458] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:50:35.861688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf981d-de5c-42cf-b655-c4a6a91a8c3e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:35.862392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf981d-de5c-42cf-b655-c4a6a91a8c3e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:35.862859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf981d-de5c-42cf-b655-c4a6a91a8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:35.882732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b8cf981d-de5c-42cf-b655-c4a6a91a8c3e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:35.883355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:35.885639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b8cf981d-de5c-42cf-b655-c4a6a91a8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:36.005043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4cee-534a-415b-a7c3-5a8de2eca3b8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.022422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 231/459] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:36.025583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ed3-33cf-41c8-915d-9e50ed904b52 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.026392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ed3-33cf-41c8-915d-9e50ed904b52 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.027194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc56ed3-33cf-41c8-915d-9e50ed904b52 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.030525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 232/460] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:36.050702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.051529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.051806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.052105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.060620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.061395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.062110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.064279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.066317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:36.088811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:36.089768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:36.090605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:36.090605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:36.090605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.090605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:36.093266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:36.093597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 229/461] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:36.094360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.097346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:36.140847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.221957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.223929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 233/462] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:36.225323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.236162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db365-3f47-4533-b23e-64261dd72622 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.295034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.295875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.296184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.296454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.308649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.310126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-40b84f90-eeda-49e0-b5cb-362861cd7442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:36.328628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:36.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:36.330451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:36.330451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:36.330451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.330451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:36.334971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 230/463] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:36.336186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf70f3-8b5c-47ae-9dd6-ffa1f9c67b00 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.336476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf70f3-8b5c-47ae-9dd6-ffa1f9c67b00 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.336753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf70f3-8b5c-47ae-9dd6-ffa1f9c67b00 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.338300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 231/464] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:36.341441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf70f3-8b5c-47ae-9dd6-ffa1f9c67b00 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.386626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a42db-3deb-4b7a-aedf-d7c638b6607d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.446276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.447416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.448515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.448515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.449748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:36.450396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.452982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.472103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf70f3-8b5c-47ae-9dd6-ffa1f9c67b00 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.478015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 234/465] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:36.479613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.513477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.531153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.532380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.532793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.533316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.551955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.553934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.569234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c5b8f8da-b1ec-4483-9c15-d9be13448f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:36.584552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:36.585469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:36.586332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:36.586332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:36.586332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:36.586332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:36.588275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 232/466] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:36.589810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.590247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.590650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.612938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:36.614706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:36.644310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23cd4e-7640-4997-9afb-354c9dc5fa74 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.699513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.699795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 233/467] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:36.700491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.701519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.702018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.702505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.703804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:36.704372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.707385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.735765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 235/468] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:36.738332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.853509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.858165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532dd5d-67d6-4896-8968-096b77918004 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.884547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b39b-9577-40f7-889d-b428f9ad344c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:36.911110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:36.921321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.922036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.922347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.922612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.923321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.924924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.926663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:36.928084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:36.928774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:36.929429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:36.930978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:36.931457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:36.934281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:36.951283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 234/469] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:36 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:36.952361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:36.956848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 236/470] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:36.959157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:37.097676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fdb30-57df-4342-b705-41a3fde6f829 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.154943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.156130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.156637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.156964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.161812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:37.175720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:37.177563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:37.183470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0db883-b197-4472-a172-8374c7640857 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:37.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:37.207929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:37.208863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:37.208863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:37.208863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:37.208863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:37.208863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 237/471] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:37.209138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:37.245505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.246462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.246908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.247196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.247933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:37.249447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a033c-e3bd-4406-b23b-f410ca4fa173 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:37.275859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 235/472] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:36 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:37.278654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda743-2c22-47e4-a356-8bd544309b0d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.279230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda743-2c22-47e4-a356-8bd544309b0d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.279699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda743-2c22-47e4-a356-8bd544309b0d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.281480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 236/473] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:37.282668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda743-2c22-47e4-a356-8bd544309b0d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:37.359395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:37.422230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97c067-d6c0-41c4-9054-18be093f7b97 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.459643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda743-2c22-47e4-a356-8bd544309b0d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.478764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.480393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.480913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.481387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.482790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:37.486066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5267d-ecf5-4dd8-a827-d909fbd3d650 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:37.531196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 238/474] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:37 2022] POST /identity/v3/users => generated 246 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:37.533792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d501-97bb-4815-962d-79360250ebed None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.534619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d501-97bb-4815-962d-79360250ebed None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.535205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d501-97bb-4815-962d-79360250ebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.537458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.538830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.539325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.540479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.542185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:37.542818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:37.552222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:37.578030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 237/475] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:37.588453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a955d501-97bb-4815-962d-79360250ebed None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:37.588453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a955d501-97bb-4815-962d-79360250ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:37.589854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:37.705969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:37.765874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 239/476] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:37.792545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d501-97bb-4815-962d-79360250ebed None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:37.841852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4036f-cb00-4ce2-9a7f-325465f01693 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.843832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:37.907381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.908092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.908437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.908715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:37.909526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:37.911136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:37.936718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 238/477] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:37 2022] POST /identity/v3/users => generated 249 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:37.952223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d501-97bb-4815-962d-79360250ebed None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:37.997838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:37.998865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:37.999322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:37.999777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:38.000759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:38.002660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:38.012654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.sql.core [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 20:50:38.012654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 06 20:50:38.012654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [parameters: {'id': 'f1453d6d79fa4bb38997473730763615', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 06 20:50:38.012654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80313) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result.read() Jun 06 20:50:38.031179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return ref.to_dict() Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:50:38.032164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application yield resource Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise self.value Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application session.commit() Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 20:50:38.033084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.session.flush() Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application compat.raise_( Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 20:50:38.034634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:50:38.035662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result.read() Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:50:38.036501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [parameters: {'id': 'f1453d6d79fa4bb38997473730763615', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:38.037468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 06 20:50:38.038332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:38.046478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 240/478] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 6 20:50:37 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:38.056513 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:38.208575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e5822-a4a0-4a4a-975a-06637742e125 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:38.247501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:38.248427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:38.248669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:38.248922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:38.261069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3b1ad934-eddc-4383-8ff3-99eee7eb005f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:38.269530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:38.270468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:38.271263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 239/479] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:38.278150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:38.375040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:38.486557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40dff5-0a3e-4126-8b6b-45832a66be03 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:38.547369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:38.548550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:38.549104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:38.549603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:38.551020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:38.551562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:38.554207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce02d6-014a-4efd-b93c-960f7d893de6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:38.570781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 241/480] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:40.693186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8d9a-6312-4091-b11e-232306570a96 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.693816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8d9a-6312-4091-b11e-232306570a96 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.693816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8d9a-6312-4091-b11e-232306570a96 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.695325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 240/481] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:40.701411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.701978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.701978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.729172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:40.730398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:40.782517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742c4c-f748-4282-a5b5-aea74462150f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.782856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742c4c-f748-4282-a5b5-aea74462150f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.783085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e742c4c-f748-4282-a5b5-aea74462150f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.784770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 241/482] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:40.796296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48a67-2ed5-4f37-a2fa-48e85ef0e05b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.796613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48a67-2ed5-4f37-a2fa-48e85ef0e05b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.796843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48a67-2ed5-4f37-a2fa-48e85ef0e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.823203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-eae48a67-2ed5-4f37-a2fa-48e85ef0e05b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:40.824614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-eae48a67-2ed5-4f37-a2fa-48e85ef0e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:40.832450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 242/483] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:40.842303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:40.878127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:40.908174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 242/484] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:40.923641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:40.926244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608cd7-0542-4bb0-8170-50896a90a479 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.926622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608cd7-0542-4bb0-8170-50896a90a479 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.927006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608cd7-0542-4bb0-8170-50896a90a479 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.929984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 243/485] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:40.938123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:40.938935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:40.939597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:40.974110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:40.975669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:41.029553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc2337-7382-48ce-9452-344362cf50a0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.075767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 244/486] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:41.076906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.113782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.115052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.115429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.115775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.132754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:41.143245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:41.144441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:41.145714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 243/487] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:41.146545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.212245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:41.242304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f794dc-fa3c-4b29-9a1a-13be430fb16f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.273852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:41.288424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7de1f-b1d2-49c1-9e84-fa4568e649dc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.303662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.305110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.305614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.306084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.324222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:41.338223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:41.339415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.340427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:41.341552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 245/488] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:41.342885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.347888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.349903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.349903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.349903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.362456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-44ed86be-83be-4a7b-998e-89a933e53f1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:41.370847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:41.372810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 244/489] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:41.374070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3501-c83c-46b8-b835-7a7d60e8931f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.382026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3501-c83c-46b8-b835-7a7d60e8931f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.382026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c3501-c83c-46b8-b835-7a7d60e8931f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.382026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 245/490] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:41.382026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c3501-c83c-46b8-b835-7a7d60e8931f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.534833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba9ad-0ed4-4fae-82b5-65a6bd97a167 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.553063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c3501-c83c-46b8-b835-7a7d60e8931f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.586813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.587960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.588498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.588987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.590451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:41.591332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:41.594245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:41.606411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:41.608398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.609327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.609786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.610204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.611126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:41.611674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:41.613488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34e53e-10c3-426e-9893-8410b232fc89 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:41.621288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 246/491] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:41.622994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.625327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 246/492] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:41.627091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.627728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.628349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.649180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:41.650426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:41.660435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:41.752025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 247/493] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:41.752025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.790722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81659-30cd-4534-a27c-778de8b702c3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.847429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.848677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.849156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.849643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:41.851079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:41.851633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:41.854318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:41.878899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 247/494] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:41.878899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:41.922870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991a007-9563-4af6-a1a1-0ab586c1a6fc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:41.980624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:41.987691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:41.988894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:41.989347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:41.989780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.007170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.009295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.012615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:42.043748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:42.045680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 248/495] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:42.047558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.062095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49f36-0129-4e38-8f21-7ca52e3d45af None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.112405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.114171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.114463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.114720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.128714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.130251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:42.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:42.153353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 248/496] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:42.154988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.213449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df73a9-4bbe-4243-82c8-cf7b1a032dd4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.256303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.257110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.257387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.257659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.269658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:42.277432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:42.279323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 249/497] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:42.281120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.311825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ebc8-36e0-4cab-a4dc-25fd70def5e3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.326491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.349111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.350107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.350493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.350857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.359706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.364089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.365882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:42.386093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:42.387639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 249/498] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:42.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.435921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff33cb-11ae-4943-8eeb-1d40fb28c35e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.483447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.484392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.484774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.485129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.485991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:42.486441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.487963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90389a1-0651-42cc-9932-1a3347558d96 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.503444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 250/499] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:42.505846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72779-c794-411b-9ba9-2d19afd91dc4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.506313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72779-c794-411b-9ba9-2d19afd91dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.506749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72779-c794-411b-9ba9-2d19afd91dc4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.509298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 251/500] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:42.510791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72779-c794-411b-9ba9-2d19afd91dc4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.531435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b066-2567-4070-b328-5c9ec82fc644 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.573497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.574098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.574378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.574649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.575409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:42.575713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.577224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.591127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 250/501] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:42.592009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.634814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.658886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72779-c794-411b-9ba9-2d19afd91dc4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.678913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.704471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.705214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.706238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.706584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.707472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:42.707903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.709506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.719012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 252/502] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:42.719888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.728474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df673-1b94-45dd-8b24-4a83c1b69a2a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.766479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.767164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.767478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.768497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.769295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:42.769624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.771062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669bfe-75ec-4032-9473-e3e9e57f326a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.783931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 251/503] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:42.785166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.785544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.785826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.803463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:42.804742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:42.846932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001ca0-6aab-4d6f-ab7d-e3fc5ae9b8db None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:42.884892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 252/504] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:42.885761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.897340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:42.898513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:42.898930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:42.899328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:42.907059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:42.910227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:42.912604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:42.929897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:42.931024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 253/505] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:42.932668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:42.977954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb89ef-d7b8-4164-930c-41ec441cc1a5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.099551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.100301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.100581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.100863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.113971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.115508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:43.143359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:43.144334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:43.145176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:43.145176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:43.145176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:43.145176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:43.145394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930697-4c7e-4bcb-ae38-5d009f32a3ba None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.152171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 254/506] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:43.153359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.183158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.183964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.184278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.184550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.192888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.194351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:43.212021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:43.213051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:43.213952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 253/507] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:43.214505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.255721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.270192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336542-eb5a-4fb3-9e23-7f3f6d3aec47 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.301025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.308422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.309243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.309525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.309797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.318504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.320032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.328242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2447b-2ee2-44db-af94-b1a0d8bb90ad None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:43.335010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:43.336623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 255/508] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:43.338777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.373827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.374511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.374787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.375057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.387134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.388653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:43.406688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:43.407693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:43.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:43.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:43.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:43.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:43.409095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 254/509] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:43.409364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.464933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da6d94-532b-48f8-a18e-74126692209b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.513056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.514069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.514532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.514973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.516369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:43.516833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.519411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.549913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264567a-0607-4ac9-806a-2909f0479bef None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.582644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 256/510] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:43.583740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.595006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.597868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.609480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.610495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.610824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.611316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.612518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:43.612963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.615321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.638911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 255/511] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:43.638911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.715135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6ffe-6cb3-4be7-ad4c-7f619380ba01 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.740084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a286b31-75d0-4aa0-be19-974a6fb4b9e5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.753154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.753964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.754342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.754676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.755672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:43.756064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.757626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.776604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.777154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 257/512] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:43.777322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.777546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.777817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.778011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.778673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:43.778981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.780468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.820675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 256/513] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:43.821682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.849384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.876829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:43.893280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836416e8-7ef1-4172-849c-1082fe591b11 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.930917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.931594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.931878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.932184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:43.932915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:43.933218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:43.934639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:43.935074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b04862-9531-4158-bde4-3c3ffee6cad0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:43.952882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 258/514] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:43.952882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:43.974376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:43.975035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:43.975320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:43.975589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.052666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.054215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.083727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c0b4-c162-4e6a-9bc5-11d0a7e47a0d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.111667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.122410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.127912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:44.129226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:44.129654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:44.130058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.143608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.145896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:44.171895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:44.173644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 259/515] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:44.175679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.192237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 257/516] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:44.193547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.314099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df3e6-d6fe-4ea0-a056-968c1a79e706 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.331476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56265-453d-4615-bcfc-802b8d2c7365 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.356504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:44.357175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:44.357454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:44.357724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.382131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:44.383236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:44.383724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:44.384238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.411775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.414774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.434476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.436009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.502147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.503953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.557873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 260/517] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:44.559397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.642686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 258/518] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:44.643911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.675674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.699790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41f23-a0fc-4a0b-a7b1-775281812a1c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.700408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:44.751974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:44.753375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:44.753865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:44.754349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.755569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.757964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.758980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162806-6063-4ee9-8786-66b691e4c144 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.789205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 261/519] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:50:44 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:50:44.790063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.807574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:44.808796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:44.809188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:44.809651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:44.811256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:44.811789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:44.814864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:44.841071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 259/520] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 6 20:50:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:44.842046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:44.948278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a053-e2b8-4228-8078-56ac02c47373 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:44.999981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaac82-44b9-40a6-a4f9-d692ea86ea24 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.003675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.008474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.009534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.010021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.010458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.023667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.026776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.029287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:45.061015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:45.062666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:45.064344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:45.064344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:45.064344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.064344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:45.064755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.065115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 262/521] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:45.065115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.065343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.065343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.065343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.079221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.080920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:45.101876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:45.102836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 260/522] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:45.104247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.237179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac58f4-5149-4fc8-9b87-294e5123e6d3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.274700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6979e2-039c-4f75-8905-47597a53b72f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.305213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.306441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.306923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.307402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.320703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.322577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.342472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.343561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.344076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:45.344519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:45.345428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:45.346317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:45.346317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:45.346317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:45.346317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:45.346544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.348775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 263/523] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:45.349941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.399902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.438712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.472238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.475019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.534567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a2270-d71f-402c-a07c-5126127b1b9c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.583345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.584318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.584772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.585125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.586006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:45.586514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.588182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.604569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 264/524] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:45.606084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.675177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 261/525] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:45.677058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.758123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62e3-1996-479f-9526-f92476a483da None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.762068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.785875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:45.814031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.815037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.815352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.815578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.816407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:45.816718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.818194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.840039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 265/526] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:45.840039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:45.885020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275c16-fe28-4688-91b3-02569e14ad07 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:45.931779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:45.932807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:45.933240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:45.933654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:45.934848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:45.935290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:45.937087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:45.960442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 262/527] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:45.960442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.018928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801b583-20a2-4cf9-baa9-b7ff4ef7b4db None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.091048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.092489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.093001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.093458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.106683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.109481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.136434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee099d-5632-4d3c-97a6-618fa5e7f860 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:46.138785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:46.140657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:46.142406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 266/528] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:46.143300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.177909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:46.194334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:46.213382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.214992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.215656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.216706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.237176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.239645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:46.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:46.274580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:46.275928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:46.275928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:46.275928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:46.275928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:46.275928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 263/529] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:46.277925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.315984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd065f-e292-4f4a-ab97-e57ad072334a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.382309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.383713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.384254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.384740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.397671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.400603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:46.429894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:46.430840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.431698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:46.432777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 267/530] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:46.433608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.468490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372673b-bf53-4e6e-80b3-240dac3411da None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.533451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.534786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.535294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.535797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.548939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.551708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.573493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:46.582365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:46.583981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:46.585540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 264/531] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:46.587810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.600844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e715e82-7c08-4295-a661-bf9854c9615b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.640348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:46.643131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.643813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.644169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.644426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.645477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:46.645787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.647950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.671238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 268/532] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:46.672150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.774315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0647-4c24-4134-981b-d17b644e3c0f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.820366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.821841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.822242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.822645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.823866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:46.824298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.826119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.849397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 265/533] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:46.849397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.856013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e74301-06ad-4338-8145-a6ae93e8600e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:46.907688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:46.908512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:46.908822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:46.909106 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:46.910330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:46.910653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:46.912320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:46.934397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 269/534] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:46.934397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:46.937229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:46.990228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:47.013972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe05cc-3aba-433f-a86f-f62cf7f4e611 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.079481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.080507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.080982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.081447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.082815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:47.083328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.085837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.112177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0cb6-6eca-42ec-83ed-c4fc9bec1475 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.116550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 266/535] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:47.117980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.180080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.181258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.181700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.182134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.183575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:47.184169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.186740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.203712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 270/536] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:46 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:47.203712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.312323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed813a7-5766-457f-b388-a36e5ed9e81a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.351074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:47.376610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.378070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.378596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.379134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.391939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.394978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:47.422954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:47.423964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:47.425005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:47.425416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aedaeb-0b01-4da5-ba18-dcfc2f33d3f6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.425488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 267/537] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:47.430085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.447788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:47.481774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.482894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.483350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.483797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.485291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=80cf9f259e6b448eafcf246c09f0ade8) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:47.485873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.488809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.498759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 271/538] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/role_assignments?user.id=80cf9f259e6b448eafcf246c09f0ade8&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:47.500200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.668414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad7ae4-6658-4527-842f-ca6eb693a3b6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.715202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b65c7-1881-4d05-8a27-b8189876fa48 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:47.737495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.738533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.738989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.739437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.741116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=9cf17e40aeb64d3598124670b5981935) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:47.741744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.746120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879672a-a2eb-413e-810f-93f1a804a28e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.757348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 268/539] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/role_assignments?user.id=9cf17e40aeb64d3598124670b5981935&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:47.759814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2b0-91ab-45c6-a46d-f229f0d502c5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.760266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2b0-91ab-45c6-a46d-f229f0d502c5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.760708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d2b0-91ab-45c6-a46d-f229f0d502c5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.763904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 269/540] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:47.770121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.770421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.770740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.785486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:47.790817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:47.792286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:47.794580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:47.795952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:47.798462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:47.799482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:47.801012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:47.801516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:47.804237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:47.838582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 272/541] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:47.848776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.910339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 270/542] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:47.937273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:47.939622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:48.064702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c063a-a4e0-4574-b76b-dc6cff15ec3a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:48.107058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:48.107894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:48.108221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:48.108494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:48.130406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:48.131715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c31e-4b60-4628-b7b1-ed25c368576a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:48.150289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:48.151974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:48.153525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:48.158430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 271/543] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:48.166560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:48.184316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:48.185405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:48.185901 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:48.186370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:48.187528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=a77e82299a2d4e679032867478dc7247) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:48.188109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:48.189881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:48.197872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 273/544] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:47 2022] GET /identity/v3/role_assignments?user.id=a77e82299a2d4e679032867478dc7247&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:48.306216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:48.385419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f35fd-80b3-441a-8009-e54252e67f38 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:48.460256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:48.461372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:48.461847 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:48.462329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:48.463787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:48.464368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:48.467343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:48.493482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 272/545] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:48.495303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:48.654505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:48.831864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979202b8-cc96-4d2a-a97d-184c0c81bd8d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:48.925279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:48.926692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:48.927187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:48.927668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:48.949169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:48.960019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:49.007371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:49.008362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:49.009209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:49.009209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:49.009209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:49.009209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:49.010049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 274/546] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:49.019260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:49.316866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337062a2-41f6-473e-a87d-0b48249c5231 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:49.358107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:49.392547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:49.393243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:49.393524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:49.393799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:49.394534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:49.394837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:49.400853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:49.428382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 273/547] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:49.432316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:49.752091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9066f-644d-40b4-aa2e-71525db20eee None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:49.784049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:49.865011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:49.866926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:49.867842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:49.868652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:49.883768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:49.886700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:49.913192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:49.915016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:50:49.916822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:49.921678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 275/548] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:50:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:49.931152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:50.146659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902888-541d-4b34-9523-167cfe9245f9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:50.212119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:50.213863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:50.214773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:50.215562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:50.218311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:50.219119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:50.222938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:50.258344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 274/549] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:50:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:50.267224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:50.491335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494182a9-ece3-46d0-b9a3-d0c44a3c762c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:50.556648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:50.558022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:50.558703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:50.559414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:50.628862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:50.692748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:50.695549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:50.890122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 276/550] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:50:50.898949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:50.996045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:51.160768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7fae-f2a2-4c41-9c6e-7a82e6eafbe1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:51.255368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:51.256826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.257323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.257802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.282764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:51.286511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e76a4644-3877-4e1e-91d1-b9a0e014109c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:51.322376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:51.323347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:51.324253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:51.324253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:51.324253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:51.324253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:51.325158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 275/551] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:51.335210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:51.342876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d89d-889a-482a-af6b-afdabe2c8cc5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.343191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d89d-889a-482a-af6b-afdabe2c8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.343433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d89d-889a-482a-af6b-afdabe2c8cc5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.344902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 276/552] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:50:51.361165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.361509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.361720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.397442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:51.398671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:51.492678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:51.542472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02eb2b-eac4-402d-865c-8ddb97484837 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:51.542915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 277/553] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:50:51.589583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:51.629285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:51.630989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.631690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.632400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.633987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:51.634754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:51.637596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a1596-3c77-444b-8b54-7c4f6e8d5cc8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:51.648858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:51.665370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 277/554] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:51.675482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5509-c992-4876-8d73-d17078302275 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.676458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5509-c992-4876-8d73-d17078302275 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.678726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5509-c992-4876-8d73-d17078302275 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.682129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 278/555] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:51.684969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5509-c992-4876-8d73-d17078302275 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:51.761060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373eec2-dfef-4312-8a84-ef7d4e08e679 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:51.800576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:51.801568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.801940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.802313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.814538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b05d44c1-a811-45cf-8b47-c46668c8f038 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:51.823985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:51.825884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:51.827587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:51.834547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 278/556] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:50:51.836619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.837215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.837770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.868219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:51.870176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:51.905568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5509-c992-4876-8d73-d17078302275 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:51.954999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:51.970478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:51.972428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:51.973171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:51.973879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:51.977816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 279/557] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:51.979066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:51.995659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.000369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.007096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c0233b08-8790-44af-b437-7d65368cc21a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:52.028874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:52.031480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 279/558] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:52.035609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-2aaf-42af-9e05-54fa2df34a41 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.037706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-2aaf-42af-9e05-54fa2df34a41 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.037706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-2aaf-42af-9e05-54fa2df34a41 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.044962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 280/559] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:52.051623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2b89a-2aaf-42af-9e05-54fa2df34a41 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.163563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6fa11-583e-481e-9985-58618351bc1f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.206463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2b89a-2aaf-42af-9e05-54fa2df34a41 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.212778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.213820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.214315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.214763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.216666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:52.217194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.219888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.236802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 280/560] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:52.238282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.250259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.251090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.251375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.251703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.266165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8cf3a9db-bdff-4235-896a-d0624d91b41c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:52.274751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:52.276839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 281/561] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:52.278550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e30e8-33fc-4647-820a-ce3837320b35 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.280250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e30e8-33fc-4647-820a-ce3837320b35 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.280250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e30e8-33fc-4647-820a-ce3837320b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.297987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0c8e30e8-33fc-4647-820a-ce3837320b35 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:52.299763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0c8e30e8-33fc-4647-820a-ce3837320b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:52.357726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:52.360105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:52.389702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13af5e-caa5-4f1d-aeff-b12eb9daf173 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27c66-3e4b-4179-80aa-59f3646ead6c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27c66-3e4b-4179-80aa-59f3646ead6c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27c66-3e4b-4179-80aa-59f3646ead6c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 283/563] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:52.416072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27c66-3e4b-4179-80aa-59f3646ead6c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.459088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.460040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.460479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.460918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.462255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:52.462759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.465402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.485196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 281/564] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:52.486506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.574547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27c66-3e4b-4179-80aa-59f3646ead6c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.615974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.616809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.617088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.617360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.629717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.631211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-31921467-4e0e-44d2-931b-d5b1c86a6135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:52.650455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:52.652371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 284/565] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.654203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.657053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825e38-8837-403c-a25a-35c080d9184a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.674733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:52.676841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:52.698119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.698799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.699076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.699349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.700162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:52.700468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.701880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.705950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:52.716011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:52.720485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 282/566] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:52.722414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.793601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 285/567] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:52.795094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.887627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8484-1055-4c81-b05e-ca1f497af76c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.929813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f82f6-285f-4899-988d-7ef34355b676 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:52.932981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.934083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.934432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.934775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.948882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:52.957945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:52.959798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 283/568] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:52.961946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:52.982954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:52.983876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:52.984329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:52.984785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:52.985809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=0e7356175da142a8a4a30b9476303b2f) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:52.986258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:52.987931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:52.995484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 286/569] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/role_assignments?user.id=0e7356175da142a8a4a30b9476303b2f&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:52.997114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.047878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.065711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.155484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766b3a-351e-4878-a645-37dd3617c4dc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.178900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee4e2-7765-404e-a74b-f0f03aa22abd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.202983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.203807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.204188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.204536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.205818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:53.206302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:53.207845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:53.223545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 284/570] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:53.224474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.255565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.256624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.257092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.257477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.274686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:53.277417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:53.311907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:53.313751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 287/571] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:53.321492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.391646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dad92-8769-4727-9b23-fc8f12426086 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.423829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.456697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.458687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.459138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.459576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.461166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.477071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:53.486651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:53.488518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:53.490130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 285/572] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:53.491241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.508275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850804ba-6788-4490-955d-f0e1542e4fbd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.568768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.569818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.570264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.570705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.571724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:53.572248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:53.574673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:53.596644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 288/573] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:53.596644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.688916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675a83-629a-4243-8692-d17bf73e2af9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.749529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.750848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.751127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.751406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.763660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef467-19ea-4161-98b8-095398d7ab5b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:53.765724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:53.768347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:53.793775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:53.796233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 286/574] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:53.799102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.843323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:53.844509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:53.845000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:53.845584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:53.846951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:53.847493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:53.850389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:53.858237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.865295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:53.883706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 289/575] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:53.883706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:53.975756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786a45-c0ea-4db2-aeac-b02a8175af06 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.015203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17adfe-b0ea-4c6f-8143-c6dba7ef1e2b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.034217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.035382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.035866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.036389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.037797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:54.038338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.041123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.068430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 287/576] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:54.070690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.089110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.090484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.091345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.091920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.106409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.107885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:54.127946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:54.129824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 290/577] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:54.131645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.215313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:54.255781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:54.262785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e10cd-155a-4ce5-8e1c-b8b4bdbcddd0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.297756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8b54-2c55-4e26-9711-4d6d5017eb95 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.337920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.341143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.342089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.342958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.343090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.343270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.343505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.343599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.345267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:54.346212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.349009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.352752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.354275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:54.372136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:54.374058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:50:54.375852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:54.378873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 291/578] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:54.380225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.393462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 288/579] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:54.395497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.564930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede81b-6957-4eb5-99c6-0deb6e9b6768 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.604522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d98d-1e6f-4c66-b72c-f1468eb08dd4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.614150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.614843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.615128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.615396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.616174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:54.616479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.617906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.626668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:54.638482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 289/580] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:54.647317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.668544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.670162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.670673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.671232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.673263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:54.696900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.700076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:54.732372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:54.734131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 292/581] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:54.737960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.849106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b275cf-a23a-4813-a22a-42944c8c33ea None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.914897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063dbb-7d10-452b-ad52-b658033fa2ae None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:54.937460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.938158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.938624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.938791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:54.939783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:54.940619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:54.943794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:54.979775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 290/582] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:54.979775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:54.985058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:54.986422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:54.986885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:54.987354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.007030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.010464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:55.048440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:55.050142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 293/583] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:55.051889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.085836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.119917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.165476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f365-cf09-41ca-8c20-38492c97be03 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.228930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.230827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.231819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.232396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.247015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1572-2259-4a8e-adc8-9510270634f8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.248639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.252868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:55.273030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:55.274837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 291/584] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:50:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:55.277440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.323898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.325526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.325526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.325872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.326846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:55.327368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.329265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.352069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 294/585] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:55.352069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.454706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078aba8-fe33-4a1d-a6a0-3b442bfc928d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.494852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.511613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.512953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.513419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.513882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.519406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.533535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.535780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.551222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b601d-bb9c-49e4-99f3-269f3539f625 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:55.566452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:55.568448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 292/586] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:55.578104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.639430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.640610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.641307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.641752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.643151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:55.643907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.646715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.678821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 295/587] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:55.678821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.739493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04129b5-77f0-4a9e-a658-bd7da67a2579 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.807328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.808576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.809061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.810535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.810710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:55.810987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.812514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.832252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 293/588] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:55.833255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.856322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5522f-9808-4f3e-a1a9-a030b037a934 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:55.899212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.904332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:55.905268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:55.905564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:55.905828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:55.909638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:55.918098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:55.920107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:55.938461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:55.940572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:55.942704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 296/589] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:55.944035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:55.974267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0c5f1-391e-4d3c-a99c-2144fb2671ba None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.017366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.018642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.018927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.019201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.019945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:56.020292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.021707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1732ff0-df57-4644-9e48-87afed8134e1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.034574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 294/590] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:56.039446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b3d9-e321-41e9-b115-591a68ab4cb1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.039446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b3d9-e321-41e9-b115-591a68ab4cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.039446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b3d9-e321-41e9-b115-591a68ab4cb1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.039446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 295/591] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:56.039446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b3d9-e321-41e9-b115-591a68ab4cb1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.091603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d258-2734-4d1b-8629-e387af19f68d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.152073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.152927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.153166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.153435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.164907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.167741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.183257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b3d9-e321-41e9-b115-591a68ab4cb1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.191340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:56.194654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:56.196472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:56.198104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 297/592] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:56.199243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.231096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.231900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.232207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.232485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.244115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.245585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:56.264386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:56.271540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 296/593] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:56.273036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.292239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.342226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd97f0-4d8e-4869-bd5b-de9e0aabaaa9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.386896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.387690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.388127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.388527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.389550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:56.389957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.391514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcdfbf-fed5-41eb-9f57-c528839749c6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.412826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 298/594] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:56.414434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.414851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.415244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.415530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577aa0a-05eb-4412-a0f0-da1d7b211e28 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.433719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:56.434935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:56.466906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.468129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.468590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.468923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.478454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.480211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:56.496360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:56.498170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 297/595] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:56.499869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.525530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.529094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 299/596] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:50:56.530489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.599977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.634490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1b87-2e59-4788-9fac-b8aa3a159488 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.674552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94c56-dca4-4618-9dd8-45d3c31eaea2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.676746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.677736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.678179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.678521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.679398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:56.679774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.681364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.697258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 298/597] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:56.698633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.724955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.726113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.726600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.727052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.728430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:56.729072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.731620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.757239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 300/598] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:56.758774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.790609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.822627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e91506-11eb-4c9d-80db-9ccdeef53828 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.867725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.868741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.869081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.869479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.883254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.884970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.890769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630d05d-7bcc-4c32-beca-2f3fe27ce093 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:56.892895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:56.911043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:56.913212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 299/599] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:56.914626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:56.944844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:56.945658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:56.946123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:56.946475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:56.947403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:56.947794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:56.949569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:56.965097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 301/600] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:56.966410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.064982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c30e1-31ea-42f3-b897-372dc8054a6e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.099241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.106079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.106906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.107180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.107445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.112918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bf2a1-0c1c-454f-a20e-caf1e6f0159f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.120859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:50:57.128799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:57.130532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 300/601] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:57.131365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.156130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.157219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.157622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.158453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.178813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=4746a0f4669742ba9e03404e04ae0536, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.180566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.196378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 302/602] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:50:56 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:57.204994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.234621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.309954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa557dcd-a7f4-4405-bf3a-67b874fe20cb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.386702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.388188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.388683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.389128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2fe45-e920-4214-bd8d-9f7ae55f1f85 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.389308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.402864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.405549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:57.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:57.438798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 301/603] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:57.441249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.443213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.443818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.444951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.445256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.446096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:57.446522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.447938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.467740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 303/604] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:57.467740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.532204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.582109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.629232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8039be9-357e-4a26-bee8-dd57bdb1a810 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.647101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1c4e-4342-463c-b2c0-0d1defd769bd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.684521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.685567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.685839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.686172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/80cf9f259e6b448eafcf246c09f0ade8/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.702719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.704372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.705069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.705431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.706328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:57.706652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.708504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=80cf9f259e6b448eafcf246c09f0ade8, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.708694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.710029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.732990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 304/605] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:57.732990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.737859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 302/606] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:50:57 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/80cf9f259e6b448eafcf246c09f0ade8/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:57.739109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:57.900051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.905494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfae23-040f-4a7f-9961-47ba692b459f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.909811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da17c-73c2-4e46-8838-7a9a6d236e6b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:57.960253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.961386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.961669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.961952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.967301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:57.968774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:57.969791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:57.970461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.970721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:57.972015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:57.972204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.972860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:57.975829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:57.978895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:50:57.992052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:57.993028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:50:57.993901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:58.000233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 305/607] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:58.001559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.005808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 303/608] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:58.013884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.152397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bbb3-1ef0-49ce-9d6b-c1b0d2a81a41 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:58.178606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcda43-9802-430c-8dda-b96c07ed4fbf None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:58.197291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:58.198440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:58.199175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:58.199614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:58.200690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:58.201152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:58.203705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:58.219748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:58.221037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:58.221430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:58.221711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:58.223308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 304/609] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:50:58.224438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.241003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:58.242651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:58.255234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:58.266838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:58.268544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:58.269655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:58.269655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:58.269655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:58.269655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:50:58.276123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 306/610] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:58.277508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.333033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:58.414905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf7d6-be3b-4760-8fbf-b5388ddc7d32 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:58.416184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e197-7532-49fd-b31c-7848d30897a7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:58.475871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:58.477833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:58.478544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:58.479219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/a77e82299a2d4e679032867478dc7247/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:58.481732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:58.482912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:58.484259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:58.484259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/9cf17e40aeb64d3598124670b5981935/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:58.508737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=a77e82299a2d4e679032867478dc7247, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:58.510497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:58.522719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=9cf17e40aeb64d3598124670b5981935, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:58.524496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:58.540347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 307/611] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:50:58 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/a77e82299a2d4e679032867478dc7247/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:58.541767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.556034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 305/612] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:50:58 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/9cf17e40aeb64d3598124670b5981935/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:50:58.740665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa39-2f22-49e8-a82c-d8b0e83cdfa8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:58.758438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:58.799371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:58.800685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:58.801391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:58.802009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:58.803004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:58.803818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:58.805333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:58.819813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 308/613] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:58.825294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:58.919843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:58.963972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d4b2-50d4-444d-b801-49f3785c74a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:59.015231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:59.016316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.016796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.017183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.026696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:59.028693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:50:59.055830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:59.056832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:50:59.057773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:59.058883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 306/614] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:50:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:59.064156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:59.203039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c627-65e4-4d6b-b753-b6724a28829a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:59.240671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:59.241761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.242358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.242841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.243931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:59.244486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:59.246150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:59.266483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 309/615] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:50:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:59.272636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:59.455611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d2f2-692b-49ea-b7c8-ef81fe5a2076 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:59.497894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:59.506475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:59.507367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.507646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.507916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.525291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:59.526741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:50:59.547511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:50:59.548625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:50:59.550317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:50:59.550317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:50:59.550317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:50:59.550317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:50:59.550317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 307/616] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:50:59.557305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:59.585054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:50:59.703569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf724142-2cb7-4543-9afe-944f84c76633 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:50:59.751439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:50:59.753737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.754258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.754729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.755713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:50:59.756298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:50:59.758077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28120e61-d237-4a84-a1f6-399d9df43506 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:50:59.786349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 310/617] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:50:59.792300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:50:59.894683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444d47-a0f9-4c50-901b-0a555914b2a7 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.895373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444d47-a0f9-4c50-901b-0a555914b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.895861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444d47-a0f9-4c50-901b-0a555914b2a7 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.897934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 311/618] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:50:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:50:59.904072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:50:59.904409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:50:59.904692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:50:59.937233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:50:59.938486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:50:59.982861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09628ea-25e1-4654-8ef7-896ae6418a4c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.030473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.032111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.032716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.034320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.057447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:00.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:00.078333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:00.079348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:00.081034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:00.084474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 308/619] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:00.096664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:00.140129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 312/620] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:00.192674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:00.203448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:00.207146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:00.336724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b7a67-c510-477c-83e7-e8df2c93e16a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.366135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade320a-082f-4de1-ab91-15e333735b4d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.388986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.389839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.390117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.390393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.419682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:00.427771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:00.428826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:00.429677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:00.440827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 313/621] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:00.446423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:00.456873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.457579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.457852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.458131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.458972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:00.459299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:00.460818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:00.502473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 309/622] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:00.510023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:00.548777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:00.581516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f0a50-a545-46ff-a536-5ade4d24993b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.623066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.623677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.623957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.624272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.625048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:00.625355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:00.627383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:00.637226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 314/623] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:00.643891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:00.773852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc157-0552-49d3-a834-fd8195b76ee9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.776043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:00.801756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f23e-ed31-4e4c-b587-4ebd319a1b62 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:00.817871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.818569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.818850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.819120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/0e7356175da142a8a4a30b9476303b2f/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.836468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=0e7356175da142a8a4a30b9476303b2f, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:00.838042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575456-2db0-4e51-8044-9a34c4dba74a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:00.844837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:00.860691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:00.862248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 310/624] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:51:00 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/0e7356175da142a8a4a30b9476303b2f/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:51:00.862843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.863602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.864072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaac03-96ba-4919-9d06-2f1e98764cab None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.864462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaac03-96ba-4919-9d06-2f1e98764cab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.864882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaac03-96ba-4919-9d06-2f1e98764cab None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.865083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.871293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 311/625] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:00.873375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:00.874128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:00.874475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:00.894860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:00.897204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:00.898618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:00.899206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:00.939787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:00.941314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:00.943046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:00.943046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:00.943046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:00.943046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:00.949145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 315/626] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:00.956374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.070017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 312/627] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:01.118314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.224333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adf19-0af6-419f-9032-5b2b14b18cf8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:01.224529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:01.238526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81c23-edef-4c56-a66a-d6e8d7e0fff6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:01.270758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:01.271848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.272410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.272883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.274046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:01.274628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:01.276732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:01.276892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:01.277723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.278068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.278405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.290549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:01.294981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 316/628] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:01.300689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:01.301674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:01.302590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 313/629] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:01.304805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.314249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.371963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:01.560123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0742-527a-4ba9-bab2-e79451ecd57d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:01.614336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c68328-c757-406c-aaa5-f10ed4e67391 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:01.633463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:01.635147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.635615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.636450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.638036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:01.638568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:01.642029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107562b-0226-49c8-b313-0372b85536fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:01.652499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 314/630] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:01.653876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26b79-28fc-4866-ab1d-377586e88646 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.654159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26b79-28fc-4866-ab1d-377586e88646 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.654431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c26b79-28fc-4866-ab1d-377586e88646 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.656051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 315/631] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:01.662256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.662551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.662812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.680380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:01.683355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:01.684938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:01.698894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:01.701242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.701679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.702096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.723422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:01.727558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:01.755081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:01.756324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:01.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:01.759734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 317/632] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:51:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:01.760826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.796168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 316/633] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:01.797768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:01.933863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:01.941402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94227074-bb2b-4d75-982b-fe6914c31f12 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:01.987074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:01.987915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:01.988226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:01.988500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:01.988858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234d7e8-5cb6-4bdf-a830-61499e19800d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.003301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.004896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:02.027359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:02.029276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:02.030888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:02.030888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:02.030888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:02.030888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:02.033808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 318/634] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:02.034812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.066714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.067403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.067684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.067957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.068897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:02.069206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.070665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.075260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:02.100633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 317/635] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:51:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:02.100633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.233969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939c21-c722-4bce-a862-d7ef7ec7f0af None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.272234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677e1f-2d2c-402d-8d9e-b4a8067e5953 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.296167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.297716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.298411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.299208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.300823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:02.301476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.304086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.323795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 318/636] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:02.325190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.351392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.353008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.353604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.353952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.378012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:02.395360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:02.396462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:02.397313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:02.403810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 319/637] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:02.404398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:02.405456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.438489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:02.487762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ea4e0-46cf-4e01-9556-f32ce3077e15 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.532463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.534002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.534742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.535220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.605338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3042-505f-45de-88ac-884a480adaf5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.634488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.636430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ea472-c35b-4592-911c-773cf7be5ae7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.644460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.645281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.645569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.645826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.654244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.655711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:02.672022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:02.673078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 320/638] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:02.674938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.714066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:02.781998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:02.796829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 319/639] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:02.796829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208941-e5df-4cec-b570-205648f843af None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.796829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208941-e5df-4cec-b570-205648f843af None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.796829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208941-e5df-4cec-b570-205648f843af None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.798066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 320/640] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:02.799365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208941-e5df-4cec-b570-205648f843af None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.836548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860667-002d-418c-bf8f-769eb7adcd99 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:02.874150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:02.874831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:02.875118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:02.875387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:02.876174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:02.876539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:02.877931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:02.886702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 321/641] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:02.887545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:02.955726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208941-e5df-4cec-b570-205648f843af None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.011595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.013059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.013719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.014495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.015972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:03.016439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.019161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451332e-482a-4c80-adaf-9ebb06b11e26 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.059604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 321/642] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:03.059604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.059604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.059604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.066269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099854b3-f37f-4d1d-9993-3eac61ba6b43 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.083279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:03.085066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:03.090433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.112500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.121158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.122380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.122799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.123259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.140198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.142350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:03.166008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:03.167101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:03.168049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:03.168049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:03.168049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:03.168049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:03.168049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 322/643] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:03.169518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.190473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 322/644] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:03.191678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.323602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b0b9b-a429-4426-8ef8-5dec11c6dfc7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.335611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2807-0111-4ae5-869d-8883a1a7cadd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.369640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.371340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.371755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.372205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.387643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.389769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.394889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.396136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.396616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.397081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:03.411675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:03.413426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:03.415355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:03.415355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:03.415355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:03.415355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:03.417911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.420328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 323/645] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:03.421967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.486984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.500877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.503250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.591592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22da62-99bc-4ae7-a240-e6008a8ffcc1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.619919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 323/646] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:03.620651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.643450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.644270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.644648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.645016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.645844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:03.646269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.647896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.664628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 324/647] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:03.665519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.673009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.752597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ac8c9-4848-4abc-b1a7-cc18e84d1cca None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.784943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.793008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b2e-f7a7-4321-9b1d-7119b938d379 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.793552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.794460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.794904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.795287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.808372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d65d69e6-fae3-41f6-ac03-8b318b69329c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:03.818217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:03.820108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:03.822560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 324/648] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:03.826740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36887-4461-4eac-be5a-669a7e22e8b4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.827297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36887-4461-4eac-be5a-669a7e22e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.828034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36887-4461-4eac-be5a-669a7e22e8b4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.829802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 325/649] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:03.831141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36887-4461-4eac-be5a-669a7e22e8b4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.836382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:03.837082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:03.837364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:03.837641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:03.838380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:03.838686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:03.840130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:03.853315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 325/650] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:03.854089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:03.951554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:03.958054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36887-4461-4eac-be5a-669a7e22e8b4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:03.981382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e344d-bc94-400c-bcf7-5235040ceb71 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.003655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.004683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.005075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.005965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.019926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.021704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.022737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.023613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.024041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.024419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.032987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.034709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:04.041514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:04.043010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 326/651] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:04.044776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-69ec5062-d02f-4065-82e1-f8f2cdf7add2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:04.057454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:04.058405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:04.059321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 326/652] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:04.060114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.060292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.060570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.078163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:04.079388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:04.092237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.154998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 327/653] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:04.155744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.181423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a95de-181d-490e-8d4b-c8677f3d9c3b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.219357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.220169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.220427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.220708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.221487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:04.221798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.223211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.239227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 327/654] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:04.239227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.263269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.302588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5ece3-ba11-4dd6-973e-9ad0c879d823 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.345379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.346284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.346568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.346843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.355231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.356747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.369205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf8f3-0d32-46f7-8dc5-c90b6a90d24d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:04.384650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:04.385855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 20:51:04.386813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:04.392351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 328/655] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:04.393555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.407624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.408514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.409192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.409420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.409690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.410703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:04.410916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.412402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.425747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 328/656] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:04.426640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.518700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.547401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade284b9-4d06-4000-8f52-30e38c388357 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.548211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae513-8a9c-4008-abfb-63ac2db14677 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.586511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.587318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.587598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.587874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.598243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.598915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.599207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.599478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.600193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:04.600317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:04.600601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.602074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:04.608015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:04.609518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 329/657] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:04.610433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.621445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 329/658] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:04.627555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.706009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.735419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce8b4-79a0-41de-a930-20d0041767c8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.747648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dd03-cb9b-40bd-aaaa-5436766f2542 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.778096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.778932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.779217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.779495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.782127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:04.792223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:04.793039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:04.793415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:04.793768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:04.794225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.794963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:04.795356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:04.795792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.797177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:04.817208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:04.819058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:04.821484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:04.821484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:04.821484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:04.821484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:04.821918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 330/659] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:04.821918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.824480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 330/660] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:04.825946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:04.949793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848de43-2553-4182-9b08-d6a8c29a2d79 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.961406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a84dd-3df6-4de6-ae5a-e0af18f0cc07 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:04.991226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.002801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.003926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.004443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.004864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.005729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:05.005826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.006227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.006563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.006842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.007112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.008275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.015546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.017048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.020114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 331/661] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:05.021217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:05.032358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:05.033788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:05.034718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 331/662] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:05.035381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.097967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.153851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4099773-8e36-4888-80e5-8461058d7e4b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.162603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f40d-408d-4c45-91e0-01fb8fc94e75 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.202685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.203351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.203631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.203898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.204872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:05.205185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.206766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.210342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.211042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.211326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.211673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.212387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:05.212701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.214131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.214313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 332/663] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:05.215118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.240879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 332/664] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:05.242937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.319104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.414962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75f438-36be-4ce8-86f6-231faa7a50f4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.416514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a0f22-e8de-408f-95cd-25bcd66dd58c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.441718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.478457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.479471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.479973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.480497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.483490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.485243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.486101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.486585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.508907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.511578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:05.534855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:05.537058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 333/665] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:05.539397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.598900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.600749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.713546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.723569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b90db-619e-4be1-9687-ae7667268c1a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.763724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.764337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.764615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.764882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.765673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:05.765974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.767561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:05.769097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 333/666] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:05.777509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.792427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 334/667] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:05.794462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:05.804843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:05.937326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6217-6b74-402c-8e8e-2c1018f44820 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.950243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ec70-9b05-4eaa-80e3-f22e1efdf065 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:05.985623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:05.986926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:05.987408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:05.987886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:05.989331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:05.989863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:05.992508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.003228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.005124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.005646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.006112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.013903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 335/668] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:06.015274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.023036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.024986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:06.043861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:06.044913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 20:51:06.045840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:06.048820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 334/669] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:06.049948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.060786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:06.147427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:06.196995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4930a-a458-4a02-9ec3-380af8ff782d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.209860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8649f5-795b-47e5-ae7a-18262b2efaf0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.257817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.258947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.259302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.259723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.261227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=80cf9f259e6b448eafcf246c09f0ade8) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:06.261729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.264335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.264508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.265689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.266144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.266573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.282546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 335/670] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/role_assignments?user.id=80cf9f259e6b448eafcf246c09f0ade8&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:06.282546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.288302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.291672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:06.329352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:06.331668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:06.333786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:06.333786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:06.333786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:06.333786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:06.338021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 336/671] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:06.339855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.463874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424d2b-f9ef-4bac-8601-b89b28af4e4c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.483066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:06.526763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.528172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.528738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.529285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.534604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:06.544144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.546899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.562051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edadb-a3e3-47c2-a822-bd76a6559540 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:06.573860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:06.575752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:06.577801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:06.583611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 336/672] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:06.586120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.646244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.647379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.647878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.648426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.649836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:06.650349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.653997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.684022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 337/673] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:06.684022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.802066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8524c0b-2a65-4bbc-a9aa-2946c3a36fa0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.846620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ceba-ade6-4c3c-9452-904b46fe1635 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:06.884976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.886094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.886590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.887079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.888559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:06.889102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.892884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.904267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:06.924180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 337/674] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:06.925407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:06.926615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:06.926798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:06.927123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:06.927598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:06.929579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:06.930113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:06.933080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:06.978916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 338/675] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:06.981585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.073714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:07.124312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f935dca-355b-4d73-ad4f-a3769b2ce0d9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.163791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:07.165019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:07.165535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:07.165642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1c4ed-fe37-452c-881c-399b2d597730 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.166104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:07.174365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:07.176264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:07.191885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:07.192909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:07.193813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:07.196416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 339/676] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:07.197559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.233958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:07.234749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:07.235509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:07.236122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:07.251145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:07.318967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b5c83-f1d6-48be-a7b8-5e71e243e80d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.359163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:07.360319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:07.360858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:07.361353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:07.379252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:07.382222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:07.440279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:07.442190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:07.489902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:07.493008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:07.578258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 340/677] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:07.580363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.584488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 338/678] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:07.586140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.753829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e94-67ab-4564-935b-0ff921c4908c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.788481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f9365-f9db-44e5-8dea-1f65d6e89aa8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.792210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:07.793260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:07.793778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:07.794287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:07.795327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:07.795861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:07.797952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:07.812836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 341/679] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:07.813966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.825615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:07.866154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:07.867634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:07.868756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:07.869230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:07.897497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:07.901937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:07.940944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378af8-fd8f-4b6c-8b1e-76e63cf9f2c1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:07.949310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:07.950289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:07.951182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:07.951182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:07.951182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:07.951182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:07.952048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 339/680] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:07.954016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:07.978753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.015574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.016354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.016634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.016953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.037407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.037407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:08.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:08.060756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:08.061786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:08.061786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:08.061786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:08.061786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:08.066644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 342/681] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:08.066644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.116788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c39a0-37ce-4b5d-afb3-f22faa09bfc4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.156761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.157797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.158287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.158736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.160364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=9cf17e40aeb64d3598124670b5981935) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:08.160842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.162610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.164870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.171737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 340/682] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:07 2022] GET /identity/v3/role_assignments?user.id=9cf17e40aeb64d3598124670b5981935&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:08.172878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.254526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c044c3-0d8b-47b5-b786-9160efa45712 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.261504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.299842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42216-8e36-42cb-b832-6a7322400966 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.325156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.326283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.326784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.327253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.328943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:08.329546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.332366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.346805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.347840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.348311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.348749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.349656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:08.350122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.351808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.359343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 343/683] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:08.377119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.377850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 341/684] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:08.379122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.509768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e45e6-14a1-4690-8d9c-061f206f06ec None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.557693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.566377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.568818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.568818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.569116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.581345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.583666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bfb327de-8b2a-4e20-a792-676154706ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:08.601751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:08.603452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 342/685] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74405d16-2b22-4c22-b361-0654a50204eb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.605248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74405d16-2b22-4c22-b361-0654a50204eb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.606453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74405d16-2b22-4c22-b361-0654a50204eb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.607015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 343/686] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:08.615212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.615566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.615922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.641127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:08.643284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:08.645405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbfac-7c0e-4555-a2b5-961c6b09ff10 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.669653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.702130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.703017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.703521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.703798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.716749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.718302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:08.734470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:08.735536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:08.736545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:08.737989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 344/687] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:08.739384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.769936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 344/688] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:08.771471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:08.896983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5b108-ef3c-49fb-85c1-b7accfc208cb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.927953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca912e-5184-45aa-a234-53d6448d2c50 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:08.932482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:08.945315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:08.946506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:08.946998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:08.947892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:08.949219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:08.949707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:08.951632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:08.967976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 345/689] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:08.969164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:09.001258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:09.002867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.003375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.003974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.005673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:09.006367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:09.009687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:09.039234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 345/690] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:09.041142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:09.108523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80756-b058-4f87-8ee0-464b84acaa93 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:09.111619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:09.152354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:09.154011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.154754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.155222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.169694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:09.180494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:09.181501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:09.182341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:09.185310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 346/691] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:09.186406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:09.232034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c39d-3f4e-4d14-800b-f2fe9c276704 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:09.244514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:09.303201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:09.304299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.304743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.305186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.307344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=a77e82299a2d4e679032867478dc7247) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:09.307849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:09.310890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:09.331310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 346/692] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:09 2022] GET /identity/v3/role_assignments?user.id=a77e82299a2d4e679032867478dc7247&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:09.333332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:09.368933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46b9-6a38-4cdb-aa09-9cea5d0860eb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:09.447296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:09.448398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.448902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.449399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.451139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=0e7356175da142a8a4a30b9476303b2f) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:09.451712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:09.454704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:09.487735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 347/693] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:09 2022] GET /identity/v3/role_assignments?user.id=0e7356175da142a8a4a30b9476303b2f&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:09.600556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:09.605145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58dff6-cadc-4d38-9cf1-c906339da29a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:09.661745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:09.662459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.662737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.663000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.663772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:09.664121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:09.665539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4995-bc60-47ec-9fd3-a6e623648039 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:09.680217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 347/694] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:09.689126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:09.730860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9109af-6026-4322-9ba9-a6f92759139c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.731115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9109af-6026-4322-9ba9-a6f92759139c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.731302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9109af-6026-4322-9ba9-a6f92759139c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.733023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 348/695] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:09.742579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:09.743082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:09.743570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:09.782864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:09.785908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:09.907805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 349/696] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:09.933376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155d7c3-44c6-4274-9259-4eca0eb02cb4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:09.948527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:09.956741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.010015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:10.010734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:10.011019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:10.011291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:10.026674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:10.028931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:10.067617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:10.069432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:10.072580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:10.072580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:10.072580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:10.072580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:10.072580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 348/697] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:10.077453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.140037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:10.160753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b3bf-3be2-4ab5-bcca-b9423a4d7790 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:10.231743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:10.233166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:10.234596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:10.235820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:10.236912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:10.239958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:10.245928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f21c6d-690e-46d8-ad47-dc6bf18015cd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:10.261716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:10.262782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:10.263701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:10.267075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 350/698] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 6 20:51:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:10.275931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.319361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:10.320516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:10.321063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:10.321534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:10.322892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:10.328028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:10.328028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:10.356480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 349/699] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:10.365255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.424604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:10.556830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cd009-3b55-4ce2-abf1-808e22086bbb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:10.634868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b7510-95eb-4c9a-85f9-f1da716f8ffd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:10.648410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:10.650655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:10.651149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:10.651637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:10.653117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:10.653667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:10.657036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:10.673175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 351/700] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:10.679890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.753954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:10.755497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:10.756003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:10.756674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:10.760387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:10.774861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:10.778023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:10.808596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:10.810338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:10.812909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:10.817771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 350/701] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:51:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:10.824730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:10.978338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d33b0-6999-4fc1-8f87-cc882df58fc4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:11.073605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:11.074317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:11.074597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:11.074858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:11.075589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:11.075977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:11.077423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:11.092494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:11.094582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 352/702] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:11.148607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be62b9-0fdc-48d9-8113-926be809fb05 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:11.220820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:11.222064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:11.222584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:11.223094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:11.224316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:11.224873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:11.226650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ced14a-c4d6-40b7-8fc1-507bfd0d3839 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:11.259290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 351/703] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:51:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:11.265379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:11.398370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:11.436109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6e9bc-3600-43cf-8891-31cedd2407c4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:11.492646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:11.493727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:11.494205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:11.494693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:11.593122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:11.597100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:11.768404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b02c3-f05f-447a-9f59-6910a0cdcc18 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:11.769186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b02c3-f05f-447a-9f59-6910a0cdcc18 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:11.769983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b02c3-f05f-447a-9f59-6910a0cdcc18 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:11.773326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 352/704] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:11.783698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:11.784955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:11.785765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:11.804070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 353/705] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 20:51:11.804403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:11.811796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:11.830230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:11.831957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:12.012144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 353/706] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:12.061864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552105-de04-477c-82e4-a0796e6067f9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.067382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.157664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.159188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.159494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.159763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.183462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.185184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.208853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:12.234566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:12.236472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:12.237673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:12.237673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:12.237673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:12.237673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:12.239774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 354/707] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:12.245655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.264549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42149d39-c35e-4e96-a133-d17e202ab3d5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.320896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.323142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.323751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.324300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.332391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:12.350946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.354442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:12.391891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:12.393747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:12.394878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:12.394878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:12.394878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:12.394878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:12.396454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 354/708] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:12.406583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.509550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db482-1624-4327-b33d-6e7ff448b3ea None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.585605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.585869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.585966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.586201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.586965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:12.587268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.588754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.622178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 355/709] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:12.624657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87c2bf-9a73-49d1-a75e-7b11e7453bf8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.633657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.649016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:12.676777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.681625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.682158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.682577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.683480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:12.683941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.685579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.708624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 355/710] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:12.711194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.829957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:12.845367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337948-1a73-45b8-8fd6-07d3975a0833 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.860046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5190-abf0-4588-ab1b-266b0ac26460 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:12.889963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.891156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.891436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.892225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.900982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.902499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f6a82904-2fd4-4994-b362-1bcb6a10ebf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:12.917473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:12.918640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:12.919586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 356/711] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:12.920106 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b3d4-9021-485b-898e-2e43e2018819 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.920839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b3d4-9021-485b-898e-2e43e2018819 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.920839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b3d4-9021-485b-898e-2e43e2018819 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 357/712] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc9ab-f4c8-4b6c-8386-cf7e8b4dfa51 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc9ab-f4c8-4b6c-8386-cf7e8b4dfa51 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc9ab-f4c8-4b6c-8386-cf7e8b4dfa51 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 358/713] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:12.928069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc9ab-f4c8-4b6c-8386-cf7e8b4dfa51 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:12.935848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:12.936589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.936868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.937147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.937881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:12.941465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd22b-1387-43d7-a8e7-92db19c9de46 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:12.970687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 356/714] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:51:12 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:12.972818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0f3c-bb4f-49d6-9420-784d0fecf9e1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:12.973110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0f3c-bb4f-49d6-9420-784d0fecf9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:12.973431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0f3c-bb4f-49d6-9420-784d0fecf9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:12.995670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e6fe0f3c-bb4f-49d6-9420-784d0fecf9e1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:12.997212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e6fe0f3c-bb4f-49d6-9420-784d0fecf9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:13.052416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.110869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc9ab-f4c8-4b6c-8386-cf7e8b4dfa51 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:13.128817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 357/715] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:13.131419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.132291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.132973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.168888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:13.171269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:13.185710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:13.186479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.186764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.187045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.187866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:13.188248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:13.191585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:13.216148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 359/716] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:13.216148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.255898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.311477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 358/717] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:13.313269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.441757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b845fe-d198-46e6-8ddd-c34e079b0b54 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:13.478336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.483895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cce1-176e-4bbe-8ae1-12289b12ea0f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:13.497147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:13.498018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.498738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.498738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.511967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:13.520540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:13.521559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 360/718] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:13.528117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.542141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:13.543739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.544505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.545249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.546875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:13.547652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:13.550531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:13.560852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 359/719] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:13.562114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.725518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5977-e29e-49c8-915c-da985f714abb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:13.772145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.779955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:13.781422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.781855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.782310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.783240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:13.783454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:13.785448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:13.803821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 360/720] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:13.814779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.826870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb0414-5f5f-416e-9f9a-d20e62404c8d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:13.847824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:13.869298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:13.870132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:13.870411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:13.870678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] PATH_INFO: `/v3/services/network` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:13.871340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:13.872902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:13.886182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:13.887256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:13.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 361/721] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/services/network => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:13.894076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:13.968657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad63167-767a-4077-a749-af9bd6223f89 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:14.016856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:14.018748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:14.019234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:14.019704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:14.069023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:14.071019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:14.151578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:14.152636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:14.153559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:14.153559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:14.153559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:14.153559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:14.154356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 361/722] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:14.163542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:14.232162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392696-953a-4ffc-ac4c-aa175774c7bd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:14.308387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:14.309545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:14.310032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:14.310518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:14.311857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:14.312427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:14.315110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:14.334619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.336835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 362/723] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:14.348107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:14.352941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.457864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57ea8-a317-46ca-969a-63db6b39f3bb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:14.498266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a5c99-a44c-4143-a9ab-01782e08a5b5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:14.538544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:14.539232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:14.539515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:14.539976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:14.540743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:14.541048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:14.542468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:14.568140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 362/724] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:14.576023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:14.584900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:14.586054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:14.586552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:14.587022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:14.587971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] RBAC: Adding query filter params (type=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:14.588560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:14.590224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:14.610972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 363/725] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:14.702817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb9af8-6f39-4877-8b88-f5e15d0a69bb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:14.742503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:14.746707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:14.747597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:14.747935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:14.748248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:14.757487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:14.759372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:14.777308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:14.778870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:14.781406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 363/726] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:14.788187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:14.952472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:15.023098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fe668-a5bc-4a6b-b5f5-dc4cbdfd10dc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:15.072408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:15.073576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:15.074068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:15.074566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:15.076265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:15.076806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:15.080107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c8df-7499-496d-b6b6-0feb4a1ac115 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:15.107415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 364/727] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:51:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:15.116037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:15.351087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae38e4-0c64-4b2d-b2b3-6193e853d63d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:15.407175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034631-019d-4c0e-8f30-7bd7a1793b85 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:15.408234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034631-019d-4c0e-8f30-7bd7a1793b85 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:15.408234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be034631-019d-4c0e-8f30-7bd7a1793b85 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:15.410028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 365/728] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:15.417061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:15.417540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:15.418031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:15.433559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:15.434766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:15.435294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:15.435886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:15.459591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:15.462916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:15.573231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:15.588885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:15.593136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:15.615720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 366/729] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:15.653139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:15.809878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 364/730] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 20:51:15.818455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:15.861768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:16.014171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d6765-2e1f-42df-8140-dc927d7e5293 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:16.097774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:16.124766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b08e11-044a-4264-8b0d-4070909c6ce7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:16.137176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:16.138331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.138844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.139332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.141806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:16.144547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:16.183673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 367/731] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:15 2022] POST /identity/v3/services => generated 251 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:16.209717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:16.211078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.211622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.212147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.227419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:16.229556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d3c724a1-c533-4ef6-a8b0-21c90933189b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:16.253190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:16.254180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:16.255118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:16.255118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:16.255118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:16.255118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:16.257927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 365/732] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:16.266691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:16.490015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa54c8-72c8-40d5-8dd5-3a7b78341f7b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.491024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa54c8-72c8-40d5-8dd5-3a7b78341f7b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.491511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa54c8-72c8-40d5-8dd5-3a7b78341f7b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.496138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 366/733] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:16.500087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.500692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.501386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.531663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822df8-d920-4fd7-9e31-c5143f52182a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:16.532748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:16.534125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:16.575218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:16.629137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:16.631734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.632680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.633446 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.635154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:16.636739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:16.640280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:16.671729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 368/734] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:16.681809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:16.685783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 367/735] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 20:51:16.726808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:16.897787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd9d4-f916-4245-83e2-12d4814a90d4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:16.954396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:16.972886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:16.974568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:16.975233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:16.975873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:16.990690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:16.993803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:17.023278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:17.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:17.027342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:17.033112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 369/736] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:17.043755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.060093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a23e-0465-47bf-bbb1-12e0b58c39bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.119202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.120600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.121030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.121580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.123262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:17.146413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-6744deb2-2842-49a7-9bdd-79b3c1486803 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:17.164448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:17.166456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:17.168241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:17.172303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 368/737] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:17.175014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a862431-7bc1-4670-97b4-1114142671b0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.175741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a862431-7bc1-4670-97b4-1114142671b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.176451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a862431-7bc1-4670-97b4-1114142671b0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.179657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 369/738] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:17.188032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.188032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.188032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.207136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:17.208453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:17.276865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ba4a-ba1f-4bc3-9a53-3fe8c60da181 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.312499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 370/739] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:17.313698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.350637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.352652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.353129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.353598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.355919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:17.356480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:17.360801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:17.392753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 370/740] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:17.394744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.409402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:17.465123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ddd8-6701-4820-bf44-14d89ba9d50e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.504910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.505899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.505899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.506209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.507029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:17.507336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:17.508921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:17.524036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 371/741] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:17.524036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.611015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:17.622812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621777-fa7f-41e6-82e1-1da307745d4f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.646567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157382-e3de-488d-9902-3f47538ea9ac None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.672861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:17.686934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.687667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.687952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.688269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.690104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=0e7356175da142a8a4a30b9476303b2f) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:17.690423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:17.691895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:17.693486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.695395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.696228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.696980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.698766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 372/742] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/role_assignments?user.id=0e7356175da142a8a4a30b9476303b2f&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:17.699637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.734210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:17.764031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:17.765806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:17.767449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:17.773571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 371/743] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:17.787815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.838069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da66bc-0877-4b96-9ecb-4d5a54cd4ae6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:17.883064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:17.883942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:17.884253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:17.884522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:17.899516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:17.901195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:17.921911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:17.924288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:17.926227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:17.926227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:17.926227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:17.926227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:17.928922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 373/744] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:17.930279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:17.984702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.146170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3652-6e9c-4fd3-9eef-66c1d090d9af None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.178174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134949-a010-4b03-ad75-3840142bb498 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.196961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.197660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.197943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.198216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.198986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:18.199297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.200811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.216430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 372/745] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:18.220040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.245169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.296557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.298320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.299436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.300355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.302287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:18.303462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.316031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.353266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6fe3a-157a-4ea9-922c-955acb383d17 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.354740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 374/746] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:18.372995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.407183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.408827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.409123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.409387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.424015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.425601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-883b779b-d6a0-4c6c-a986-c707e0c217fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:18.450964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:18.452717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:18.454374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:18.454374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:18.454374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:18.454374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:18.454374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 373/747] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:18.454919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4212-0af3-400a-9aac-e05644677d4f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.454919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4212-0af3-400a-9aac-e05644677d4f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.455875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4212-0af3-400a-9aac-e05644677d4f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.460439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 374/748] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:18.461492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4212-0af3-400a-9aac-e05644677d4f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.547155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1dd98-7e78-4305-b525-f9d89f0d99b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.549354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.568615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.592401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.593562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.594073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.594589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.604391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.606327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.610427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4212-0af3-400a-9aac-e05644677d4f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-74bee46f-9031-4506-8d8e-692655c839cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:18.624856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:18.626010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:18.627694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:18.635157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 375/749] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:18.637093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.637641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.638116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.652800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.653499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.653787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.654064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.655135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:18.655452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.656925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.660470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:18.662174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:18.678177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 375/750] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:18.678177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.753538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 376/751] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 20:51:18.754990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.837037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af28bf9-d720-4788-8b32-e893100d6502 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:18.881089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.889288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:18.890430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:18.890975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:18.891492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:18.892940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:18.893509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:18.895214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:18.924149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 376/752] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:18.925532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:18.984642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:18.993651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe5741-e5c5-42ab-b057-96be69c3fd94 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:19.065970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:19.067403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:19.067886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:19.068428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:19.083891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:19.086694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:19.087308 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5dc76-75e6-40b0-9686-1296b0c83fd1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:19.118759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:19.119801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:19.120879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:19.126777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 377/753] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:51:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:19.128395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:19.141553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:19.143023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:19.143538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:19.144077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:19.145030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:19.146666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:19.166765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 377/754] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:18 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:19.168172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:19.316363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:19.385026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de50b24-dfa1-45c8-9bad-0e44ad638bb8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:19.442642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed620e-f45c-40c2-ab09-86e3958b307a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:19.485245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:19.485640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:19.486387 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:19.486711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:19.486866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:19.487002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:19.487295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:19.487458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:19.488228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:19.488547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:19.490065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:19.511703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 378/755] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:19.521839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:19.539113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:19.605108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:19.606718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:19.727873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201788-b419-4a22-82df-b87b667d7dce None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:19.730446 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:19.796182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 378/756] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:51:19.800252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:19.805527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:19.806788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:19.807238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:19.807671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:19.826369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:19.829406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:19.877716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:19.879325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:19.885662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:19.885662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:19.885662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:19.885662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:19.885662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 379/757] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:19.888540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:19.914519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.087859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9c9-b13b-4737-88a9-3f19a3c3036a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.155522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.157665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.158412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.159389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.179500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.182761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.202198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae84d-85e3-4c79-bd2f-08d67260ef25 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:20.218652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:20.220749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:20.222474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:20.222474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:20.222474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:20.222474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:20.226596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 379/758] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:20.234053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:20.280158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.281312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.287139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.287709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.289334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:20.289861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.292505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.330490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 380/759] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:20.339461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:20.377900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.489240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.493466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edeb5-2527-41d1-8ece-10a4628c2479 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.557294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.557972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.558428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.558708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.560097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:20.560563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.562001 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591af9-a618-4480-bb1b-06620d88915f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.584392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 380/760] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:20.586798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e6f5-f790-4760-944e-b586e3c70065 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.587223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e6f5-f790-4760-944e-b586e3c70065 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.587675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e6f5-f790-4760-944e-b586e3c70065 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.593037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b6e-def1-4aff-9aa1-a48c6c743e3a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.595812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 381/761] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:20.597973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529e6f5-f790-4760-944e-b586e3c70065 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:20.636902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.638162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.638680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.639179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.648650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.650506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-02869325-250a-4437-ae42-11bebc162c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:20.667723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:20.668765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:20.669644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:20.672472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 381/762] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:20.675101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.675668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.676182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.698228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:20.699870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:20.780843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 382/763] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:20.782382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:20.786883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:20.816801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529e6f5-f790-4760-944e-b586e3c70065 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.886301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.888416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.889329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.890094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.905137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.906154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf286bf9-d0b8-46b8-ae41-291eff8e0b96 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:20.908937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:20.938982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:20.940762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:20.942482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:20.947828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 382/764] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:20.949685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:20.956103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:20.956855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:20.957177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:20.957441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:20.958201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:20.958507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:20.960386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:20.980054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 383/765] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:20.980054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:21.024647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:21.061825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:21.105896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dc501-5f6a-42f0-9715-d8387d2f7751 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.144408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.145422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.145892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.146371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.147385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:21.147923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.149741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:21.161916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba666c0f-6ba0-4cd9-b107-7783a750580d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.170585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 384/766] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:21.171983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:21.235160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.235160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.235160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.235160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.235826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.237970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:21.267511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:21.269046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:21.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 383/767] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 6 20:51:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:21.272722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:21.320769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d120-926d-4adc-b2c3-e3575aad721a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.351206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:21.366162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.367701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.368268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.368767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.371233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=4746a0f4669742ba9e03404e04ae0536, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.373001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:21.394881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 385/768] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:51:21 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:51:21.396377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:21.475890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:21.517670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dc2c-a1ed-41d2-84c9-13ac92b11ad7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.621371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.622501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.622995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.623566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.624761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=52c2cce5fd744ac9a278955e1ae3bc8a) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:21.625303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.627891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:21.650456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 384/769] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:21 2022] GET /identity/v3/role_assignments?user.id=52c2cce5fd744ac9a278955e1ae3bc8a&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:21.660377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fa39-943f-4c37-b182-685039246c85 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.733885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.735077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.735662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.736334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.737491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:21.738046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.740853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be828-f4b2-45c6-b239-514bcb6aaa56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:21.751853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 386/770] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:21.761511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:21.916989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adce5a-c5d0-4f85-943d-619aa4334fdc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:21.961437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d64d5-689d-4a9b-b862-7b2b5e7f1609 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.961941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d64d5-689d-4a9b-b862-7b2b5e7f1609 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.962428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d64d5-689d-4a9b-b862-7b2b5e7f1609 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.965365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 387/771] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:21.975516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875704ce-644c-4176-9197-33be13a894fc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.976224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875704ce-644c-4176-9197-33be13a894fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.976773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875704ce-644c-4176-9197-33be13a894fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.989023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:21.990087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:21.990587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:21.991111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:21.992782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:21.994451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:21.996150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:22.011007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 385/772] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:22.027694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:22.028176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-875704ce-644c-4176-9197-33be13a894fc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:22.030269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-875704ce-644c-4176-9197-33be13a894fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:22.093843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:22.156931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:22.243580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 388/773] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:22.329994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875704ce-644c-4176-9197-33be13a894fc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:22.345885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c007a4-36ab-4720-bf0e-b27492ffaa9f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:22.452247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:22.453403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:22.453963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:22.455227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:22.456451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] RBAC: Adding query filter params (interface=public, service_id=11515666478040b6a98cd6849c6a9f5f, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:22.457008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:22.458698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1ed4-f543-4020-bffa-6bde3d2e7d49 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:22.468945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 386/774] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:22 2022] GET /identity/v3/endpoints?service_id=11515666478040b6a98cd6849c6a9f5f&interface=public®ion_id=RegionOne => generated 194 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:22.471730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22baeb-2269-4abc-9216-840a378a293e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:22.472308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22baeb-2269-4abc-9216-840a378a293e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:22.472787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22baeb-2269-4abc-9216-840a378a293e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:22.474794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 387/775] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:22.484473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:22.485338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:22.486505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:22.506407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:22.508140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:22.551650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875704ce-644c-4176-9197-33be13a894fc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:22.601367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 388/776] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:22.602830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:22.640700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:22.663464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:22.664936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:22.665448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:22.666039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:22.687887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:22.715356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:22.716764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:22.717599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:22.718804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 389/777] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:22.724138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:22.742791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de62c6-f790-4a4d-ad29-65f04f914f79 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:22.787250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:22.788514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:22.788888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:22.789259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:22.790061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:22.791578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:22.799118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 389/778] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:22 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:22.800313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:22.824284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:22.913863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:22.983357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c787-c835-4495-af78-f4d843de4526 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.010599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842d91-c905-4d4d-b4f1-f5d97f24a4ef None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.063188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.065423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.066442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.067244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.069207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:23.070231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.073580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.094018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 390/779] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:23.104196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.126624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.127475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.127795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.128066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.128746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.130211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:23.157377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:23.159309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:23.160927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 390/780] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:22 2022] GET /identity/v3/services/network => generated 88 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:23.165128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.302232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75428-40d7-4d3b-8dcc-2020df8e5cd3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.305049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:23.342141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ffc-beea-415d-a805-124f0992e807 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.348386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.349284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.349420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.349762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.350409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] RBAC: Adding query filter params (name=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:23.350724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.352518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.364110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 391/781] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:23.365179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.418186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:23.428183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.430570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.431378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.432249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.455682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.459541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:23.497521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:23.499185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:23.500941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:23.500941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:23.500941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:23.500941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:23.501361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac725-77e4-478b-b30d-26984bc1606b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.505443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 391/782] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:23.515777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.541788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.542430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.542694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.542977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.543705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] RBAC: Adding query filter params (type=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:23.544031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.545440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.551785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 392/783] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:23.558194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.592321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:23.670724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7da26-1dd9-4b69-89ee-24c67cf8c5fb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.708285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.709069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.709416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.709775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.710644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] RBAC: Adding query filter params (interface=public, service_id=dc31116d56f54b63ad3afad6538f687b, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:23.711140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.712651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.722146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 393/784] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/endpoints?service_id=dc31116d56f54b63ad3afad6538f687b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:23.728062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.736172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ae2e2-479d-400e-8502-61a50c0beb56 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.807026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.808747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.809542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.810508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.812162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:23.813039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.815984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.831501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:23.838724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85288b-1ae6-4e1d-8f94-1a3f15f3883c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:23.846903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 392/785] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:23.856847 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:23.877207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:23.877949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:23.878244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:23.878501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:23.879129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:23.880591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:23.886944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 394/786] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:23.962265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:24.074423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2471b-4942-4bc8-a356-b9733aabad3f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:24.141991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:24.143932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.144733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.145502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:24.160861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:24.164086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:24.196639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:24.198474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:24.200302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:24.205502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 393/787] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:24.216119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:24.429976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca6d1-0343-4db4-bab4-4793be61bac5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:24.498231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:24.499925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.501124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.502339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:24.504320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:24.505165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:24.515214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c8f44-c179-4d28-8a53-977918f21076 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:24.561623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 395/788] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:51:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:24.569083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:24.596071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a496-9e4f-46bf-b2e6-c827e9c2c32c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.596071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a496-9e4f-46bf-b2e6-c827e9c2c32c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.596071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a496-9e4f-46bf-b2e6-c827e9c2c32c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:24.596881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 396/789] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:24.602693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.603070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.603310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:24.621410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:24.622740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:24.635243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:24.705654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 397/790] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:24.735007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:24.854965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1344997-4338-44ba-a2bc-29a25e439c9a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:24.882082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620654-8d6e-4cd7-8cd8-3a687d63333d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:24.890023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:24.899891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:24.901000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.901452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.901866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:24.915390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:24.925227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:24.926370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:24.927327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:24.929981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 398/791] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:24.936298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:24.956682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:24.989590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:24.990419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:24.990942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:24.990942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.004561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.006080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:25.036019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:25.036979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:25.037868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:25.037868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:25.037868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:25.037868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:25.050449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 394/792] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:25.051909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.126117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547ca18-98b1-4e45-854c-ab741f21e32a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.188531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2d09-342a-4e31-a921-e10ae062ca4b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.219300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.220008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.220303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.220576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.221330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:25.221632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.223069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6fa06-e946-4cd6-94a5-e2e4165faa39 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.232778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 399/793] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:25.234170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c57f-f623-4a71-a74f-60e82f76e7ee None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.234455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c57f-f623-4a71-a74f-60e82f76e7ee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.234728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c57f-f623-4a71-a74f-60e82f76e7ee None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.240143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 400/794] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:25.241080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c57f-f623-4a71-a74f-60e82f76e7ee None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.244902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.246508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.246798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.247081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.247824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:25.248186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.249743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702df-6707-4f70-b717-fdd160c3b8ea None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.272146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 395/795] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:25.273614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.273901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.274175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.296576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:25.298985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:25.316440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:25.325612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:25.372370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c57f-f623-4a71-a74f-60e82f76e7ee None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.408174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 396/796] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:25.409477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.414909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.415735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.416026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.424515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.443294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.444741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:25.467360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:25.468580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 401/797] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:25.470112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.546450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8cc5-5a62-43bb-ad4d-ea35b887c0a0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.584456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.585265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.585591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.585800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.593753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.595262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.598656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8c8a-351c-45fa-9ab3-aa1bdac86345 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:25.610581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:25.612111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:25.613225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:25.616411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 397/798] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:25.617372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.627730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:25.628764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:25.649061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.650051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.650519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.650809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.667060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:25.678128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:25.679530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:25.680586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:25.684155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 402/799] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:25.685679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.784348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df86f8-6a43-4f5e-9718-dc464bc249f5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.833156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a924a4-ae63-42d1-becd-84a76ebcfd57 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:25.849804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.851671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.852546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.853309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.854814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:25.855527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.858486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.884063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:25.884628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:25.884917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:25.885450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:25.885809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 398/800] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:25.886118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:25.886433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:25.887924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:25.888724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.916394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 403/801] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:25.918565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:25.982429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.007482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.059418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d878e9-353c-4f3f-aa47-2067294b62f7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.091421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224ceb9-1909-4069-a2b7-2178970a4396 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.117979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.118666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.118946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.119292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.120137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:26.120444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.121860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.136238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 399/802] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:26.136238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.152070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.153605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.154164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.154737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.169090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.170597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-805a3889-393e-4ce0-b143-5090b830d297 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:26.187287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:26.188476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:51:26.189436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:26.189986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 404/803] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:51:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:26.191060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aadc9-9560-485e-8c4d-b0837d1023c9 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.191352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aadc9-9560-485e-8c4d-b0837d1023c9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.191630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aadc9-9560-485e-8c4d-b0837d1023c9 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.193240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 405/804] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:26.193892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aadc9-9560-485e-8c4d-b0837d1023c9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.271624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9082-5b58-46db-9584-b002c84ef473 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.314948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.316329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.321585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aadc9-9560-485e-8c4d-b0837d1023c9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.328835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.331423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.331917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.332424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/0e7356175da142a8a4a30b9476303b2f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.336097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=0e7356175da142a8a4a30b9476303b2f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.338798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5ceb4-cdb0-478f-a06d-593695f1c123 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.368036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 400/805] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:51:26 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/0e7356175da142a8a4a30b9476303b2f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:51:26.368036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.368036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.368036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.371623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.373210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.373806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.374285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.386637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:26.388375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:26.397721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.401000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:26.449697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:26.451146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:26.452127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:26.452127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:26.452127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:26.452127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:26.456189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 406/806] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:26.457580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.500157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 401/807] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:26.502426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.659346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acefc-df2a-468a-a336-02c3c777a2c8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.716223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4102d5-a793-473a-9966-f20c331ed84b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.726020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.727255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.727785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.728298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.729630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:26.730176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.732772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.754524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.762700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 407/808] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:51:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:26.764356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.784554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:26.792968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.794145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.794644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.795205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.796334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:26.797197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.799551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:26.822360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 402/809] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:26.831305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:26.919158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a49b0f-e765-409b-93aa-a6dd29b9504e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:26.992730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:26.993632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:26.993915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:26.994192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:26.994975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:26.996635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:27.012328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:27.014339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 20:51:27.016683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:27.019371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 408/810] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Jun 6 20:51:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:27.020553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.043551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104f62-5430-4b96-91d0-e6d0f80aad2c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.144595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.146165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.146931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.147692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.157151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.198002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709bdf1-9b74-41a4-9dc6-bdfa92fd4865 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.228461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.255854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.257402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74047ec-cf65-421a-9f89-b4497864c05d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.257861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.259277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.259806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.260296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.276068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.278759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:27.307971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:27.309802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 409/811] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:27.312688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.396593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 403/812] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:51:27.396593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3d8c9-75fa-446d-b7f2-e9f8575a8110 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.396593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3d8c9-75fa-446d-b7f2-e9f8575a8110 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.396593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3d8c9-75fa-446d-b7f2-e9f8575a8110 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.396593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 404/813] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:27.397454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3d8c9-75fa-446d-b7f2-e9f8575a8110 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.485297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1effe-ffb7-461f-accb-16b03f38c8c2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.529260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.542608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.543810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.544392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.544951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.546256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:27.546871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.549351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.551444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.563416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 410/814] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:27.563416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.580492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3d8c9-75fa-446d-b7f2-e9f8575a8110 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.639293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.640363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.640703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.641041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.642012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:27.642392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.644203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6e73f-d767-4e92-bc30-97e531038fbe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.665631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 405/815] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:27.666968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.667334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.667612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.689230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:27.690602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:27.713089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfbf7b-1a70-4c86-b1c3-0b56ef39b32a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.755047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.755796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.756096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.756372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.768875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 406/816] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:27.769771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.781871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.785741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:27.806166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:27.807490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 411/817] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:27.809872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:27.872390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.875269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:27.924428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ad189-fb10-4955-b793-5af1bd9285f1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.937200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dde9e-d27c-418a-8133-96a31c900a72 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:27.978361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.979041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.979427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.979717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.980457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:27.980758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:27.982270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:27.991915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:27.992771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:27.993301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:27.993489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 407/818] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:27.993612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:27.994449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.007404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.009020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:28.043864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:28.044882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:28.045760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:28.045760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:28.045760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:28.045760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:28.046711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 412/819] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:28.050304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.165358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04c6dd-2588-4e16-9d18-21ac1780614d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.168091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb56fa-50db-4c56-863b-367e5dacfbaa None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.170765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.206415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.213296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.214262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.214546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.214825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] PATH_INFO: `/v3/services/network` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.215506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.217325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:28.230939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:28.233014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:28.234952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 408/820] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:27 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:28.240923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.243206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.243914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.244233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.244521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.245269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:28.245579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.247024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.262721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 413/821] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:28.265099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.389578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523061b-a705-4853-9346-66ce3316c898 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.397910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a5e50-1b0e-4187-baee-5346f3a94462 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.439969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.440858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.440994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.441502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.442818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.444844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.449236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.450419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.450914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.451382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.452473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:28.452784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.455170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.484031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 409/822] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:28.484031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.484569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 414/823] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:28.484569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.516386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.568944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.625045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9077a60-5007-4651-9a10-5e8796681fc3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.677241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45309795-48b4-47f3-ae10-b98757319fbe None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.697388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.699152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.700011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.700507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.720678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.723359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.725243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.726201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.726937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.727315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.728324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] RBAC: Adding query filter params (name=network) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:28.728755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.730444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:28.745526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:28.747535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:28.749551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:28.750386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 410/824] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:28.750386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.758894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 415/825] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:28.758894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.861474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.900751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a1e8b-1712-4c56-b80e-67bf4652a307 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.903637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dbba8-b3d3-4d25-9fe5-c16c2c47a662 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:28.923650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:28.946070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.946989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.947266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.947584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.948795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] RBAC: Adding query filter params (type=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:28.949101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.950803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:28.962420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 416/826] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:28.963541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:28.972528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:28.974072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:28.974698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:28.975254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:28.983887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:28.985647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:29.004108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:29.005819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:29.007526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:29.012266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 411/827] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:29.013214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:29.112124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de2ed-22f6-4487-8d36-7212f499a31b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.150415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.151136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.151523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.151804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.152721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:29.153028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:29.154468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f44b1d-1f03-416d-87f0-eb8de5940df2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.158301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6f89-4e40-4f05-b3ca-efa4c0ab4852 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 417/828] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee37eea-746e-41a9-ba96-55ca31d7012a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee37eea-746e-41a9-ba96-55ca31d7012a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee37eea-746e-41a9-ba96-55ca31d7012a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 418/829] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:29.174952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee37eea-746e-41a9-ba96-55ca31d7012a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:29.189747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:29.210440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.211398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.211785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.212266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.213330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:29.215136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.242571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 412/830] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:29.243769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:29.295026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:29.391117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee37eea-746e-41a9-ba96-55ca31d7012a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.432010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0364fc-40c7-4c2e-ba40-f54bad1d19f9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.461388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.462951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.463673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.464416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.466428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:29.467216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:29.470179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632273ac-050e-4b79-82f5-c2a091ea18fd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.491646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 419/831] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:29.493450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.493737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.494008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.499418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.501360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.501360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.501360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.502220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:29.502534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:29.504934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.511502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 413/832] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:29 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:29.512488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:29.514615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:29.516332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:29.599161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:29.617743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 420/833] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:29.642708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:29.649904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:29.670417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef2dd-c88e-4e25-b398-7008dbe15d19 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.718979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.720869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.721162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.722117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/52c2cce5fd744ac9a278955e1ae3bc8a/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.744030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=52c2cce5fd744ac9a278955e1ae3bc8a, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:29.745702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:29.776032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 414/834] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:51:29 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/52c2cce5fd744ac9a278955e1ae3bc8a/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:51:29.804799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891459a-780d-475a-baa4-0fc682a98d54 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:29.848355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:29.849240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:29.849576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:29.849851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:29.867262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:29.876389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:29.877507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:29.878585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 421/835] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:29.887279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:30.031258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829841ae-013e-41c1-8d35-dd804c9cb1a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:30.078202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:30.079004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:30.079377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:30.079659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:30.083888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:30.084260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:30.085689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:30.097819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 415/836] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:30.105823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:30.212064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:30.288058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21552b3-9c6a-4264-a6e4-14b2df93dc55 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:30.329331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:30.330174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:30.330457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:30.330722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:30.344948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:30.346514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:30.366981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:30.367948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:30.369336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:30.369336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:30.369336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:30.369336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:30.369336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 422/837] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:30.374627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:30.378358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:30.498065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222969-7303-49f3-973b-cd9dc5bbdda0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:30.539940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:30.541518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:30.542018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:30.542490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:30.543493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:30.544051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:30.545738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:30.561234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 416/838] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:30.566784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:30.674111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658a5c-713b-49d9-bf31-da21737b33b8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:30.677033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:30.712463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:30.713364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:30.713650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:30.713922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:30.722982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:30.724689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:30.741030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:30.742080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:30.743296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 423/839] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:51:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:30.748762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:30.816524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:30.863957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1b4c4-8a16-45bb-9e50-b0d0748625ea None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:30.900104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:30.900810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:30.901089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:30.901362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:30.902231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:30.902529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:30.904104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:30.925849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 417/840] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Jun 6 20:51:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:30.931735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.047001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f979c-d569-443d-a5c6-75a4dea35a6f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.087966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.089027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.089509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.089994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.128209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:31.166441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:31.168514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad023a0-a148-4103-9d77-62b7a7521e8e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:31.275156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 424/841] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:51:31.281267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.294134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43a40-1c51-417b-8597-d955be2e913b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.294814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43a40-1c51-417b-8597-d955be2e913b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.295457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43a40-1c51-417b-8597-d955be2e913b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.297430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 425/842] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:31.304950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.305557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.306034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.323738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:31.325313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:31.393926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:31.399285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 426/843] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:31.437108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.438324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f433c3c-4055-4b24-94f8-8611265d1606 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.469195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:31.489789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.490984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.491421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.491835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.504397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:31.506234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:31.526858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:31.528097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:31.529013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:31.529013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:31.529013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:31.529013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:31.531342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 418/844] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:31.541208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.593232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee547b-802b-4c51-982a-97b9cd97e3b6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.644463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.645660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.646131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.646605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.647818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:31.650382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:31.672997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:31.674063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:31.675341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:31.676114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 427/845] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:31.681506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.718360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fd4d-55e9-46a5-ad24-9fb5fbc09c6f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.747327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:31.756924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.758015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.758496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.758963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.759891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:31.760486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:31.762106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:31.775365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 419/846] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:31.784053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.796073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa2044-ecb8-40aa-b12b-a8269fa60031 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.818506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:31.834859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.835604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.835893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.836395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.837137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:31.837446 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:31.839591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:31.848115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 428/847] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:31.853072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:31.927036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c5d77-20cd-4f16-ba52-90c4461d42c9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:31.985999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:31.987690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:31.988234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:31.988925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:31.995388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf964727-aa82-4619-8ae1-05bbb007e1b2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:32.001827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:32.004905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:32.022028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:32.031729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:32.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:32.035483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 420/848] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:32.041386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:32.043506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:32.043871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.045468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.046285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.052098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:32.052873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:32.055526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:32.064970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 429/849] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:32.173193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:32.186235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bed9f-4043-4cd2-9524-393fe56addb0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:32.231783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:32.233044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.233602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.234114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.235334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:32.235940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:32.237992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe59ab-8992-437d-86f3-3b52f0f5213c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:32.253706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 421/850] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:32.261286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:32.398469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9267d-b917-47b0-8ac0-b1918c4c45d0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:32.439128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:32.439773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.440097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.440377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.441216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=0e7356175da142a8a4a30b9476303b2f) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:32.441525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:32.442994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103abbe-646e-4833-99c2-5a504f48b0f0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:32.453562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 430/851] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:32 2022] GET /identity/v3/role_assignments?user.id=0e7356175da142a8a4a30b9476303b2f&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:32.473734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795729d-666c-48f9-a073-c91dfc2f13ae None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.474349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795729d-666c-48f9-a073-c91dfc2f13ae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.474798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795729d-666c-48f9-a073-c91dfc2f13ae None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.477600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 422/852] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:32.486091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd290c-9dcf-4d72-9c93-e83c16d19631 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.486558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd290c-9dcf-4d72-9c93-e83c16d19631 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.487007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd290c-9dcf-4d72-9c93-e83c16d19631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.511672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2bbd290c-9dcf-4d72-9c93-e83c16d19631 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:32.513277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2bbd290c-9dcf-4d72-9c93-e83c16d19631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:32.590194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:32.627592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 431/853] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:32.665259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795729d-666c-48f9-a073-c91dfc2f13ae None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:32.822954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175748-1825-4cc0-8b84-d90f9757d3e4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.823499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175748-1825-4cc0-8b84-d90f9757d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.823920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175748-1825-4cc0-8b84-d90f9757d3e4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.827181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 432/854] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:32.835986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.836486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.836991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.847661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795729d-666c-48f9-a073-c91dfc2f13ae None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:32.867534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:32.869736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:32.887610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:32.888486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:32.888768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:32.889046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:32.890309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:32.892078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:32.908500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:32.909563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:32.910444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 423/855] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 6 20:51:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:32.921254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:32.962124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:32.979605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 433/856] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:33.021062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:33.095231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f524-8692-4a98-8b26-5b244099b438 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.133845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.134528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.134810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.135085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.135814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:33.136144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:33.137558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:33.148142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 424/857] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:33.153665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:33.241771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5cc2-be0f-496d-867a-c08d9afe19ee None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.265126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.296314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.321471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.323481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.324366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.325304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.331519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9eb88-33f8-4838-b1e1-dd3e4a05d800 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.347168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:33.362021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:33.363810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:51:33.365460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:33.370111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 434/858] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:33.376555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:33.389280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.389974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.390252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.390523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.391303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:33.391605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:33.393061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:33.412029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 425/859] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:33.544906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb148ec9-70b2-4e48-9a34-640a3d5eef50 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.591118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.591814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.592149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.592424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.593190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:33.593501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:33.595061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:33.605464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 435/860] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:33.611249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:33.732771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23331-e2a6-4bbe-b7f5-17e520c48898 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.770780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.772107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.772588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.773069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.785943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:33.787492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:33.790420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:33.806766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:33.807748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:33.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:33.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:33.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:33.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:33.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 426/861] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:33.814015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:33.851019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:33.927429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00367498-6c2f-442f-9304-2f02f976a046 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:33.963150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:33.963821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:33.964132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:33.964409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:33.965123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:33.965422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:33.967127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:33.979696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 436/862] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:33.985399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.091316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c6c8-8d89-4061-acdb-4f5a14c2f08e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:34.127489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:34.128345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.128624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.128894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.136965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:34.138423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:34.153297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:34.154299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:34.155247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 427/863] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:34.160693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.264441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.270847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babb6b8-34ef-447a-b7c9-7be9d3f3c8f2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:34.306675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:34.307370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.307648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.307920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.308789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:34.309092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:34.310541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754547aa-f21c-4c1b-a285-21afd830eac8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:34.330437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 437/864] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:34.336044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.395535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.442513 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeea4c-fe82-4242-a3d6-f1f92de6cf9f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:34.478930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:34.479589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.479865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.480163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.566198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e6e0-a46d-427b-95cb-86e9cd42bac4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.566546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e6e0-a46d-427b-95cb-86e9cd42bac4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.566793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e6e0-a46d-427b-95cb-86e9cd42bac4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.567051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:34.568754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:34.572899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 438/865] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:34.574172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.574467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.574746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.593038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:34.594950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:34.637720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.696028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 428/866] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:51:34.697818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 439/867] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:34.699013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.725914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.817101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:34.833913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce80f08-ee57-4b58-b46d-f0d035e94e76 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:34.847516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96cc10-ae7b-4657-ac29-ad183aa4117a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:34.875334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:34.877067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.877395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.877880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.894587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:34.896276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.896756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.897214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.897318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:34.898251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:34.899703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:34.900014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:34.921672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 440/868] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:34 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-382a06e8-cc6f-4a34-8897-9f8f90c1eea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:34.937694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:34.939595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:34.941000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:34.941000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:34.941000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:34.941000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:34.943312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 429/869] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:34.953940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:34.978506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71c1c-f45e-4003-9b53-2a512a972917 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.979193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71c1c-f45e-4003-9b53-2a512a972917 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.979854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac71c1c-f45e-4003-9b53-2a512a972917 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:34.983610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 430/870] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:34.990446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:34.991082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:34.992125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.016893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:35.018989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:35.021548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.139111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736493-6340-4b5a-a78f-c24268dc8ccd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.144629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 431/871] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:35.177252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.185763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.186997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.187281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.187551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.189170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:35.189485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.191441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.202568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.207719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 441/872] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:35.217111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.331787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f8093-6a20-4465-9d61-fd09947e0d08 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.379018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.380526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0142f6-0bdb-4a53-bbd6-a614a4ad2434 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.380731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.381176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.381693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.382869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.384774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.387746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:35.404041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:35.405468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:35.406572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:35.410121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 432/873] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:35.416260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.431740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.432619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.432902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.433175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.444693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.447070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:35.477169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:35.478134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:35.479000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:35.486357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 442/874] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:35.487700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.571262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d4849-1d29-48db-bb8b-5dda21cb43a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.579963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.628969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.630557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.631117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.631567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.632734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:35.633650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.635523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.636704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0280a-13e5-46db-8c1a-94d75c417614 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.649230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 433/875] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:35.650503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.693813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.695063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.695565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.696691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.699404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:35.699749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.701653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.728101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 443/876] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:35.730061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:35.753747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.831352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beeb0b-fb98-43e2-8265-b89d8965dd34 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.889489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.890145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.890428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.890701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.891612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:35.892169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.893715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51c2-c422-4f62-99d2-41438eba5380 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.899476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 434/877] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:35.901203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeae42a-364c-4eab-b004-a82ad22af661 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.901678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeae42a-364c-4eab-b004-a82ad22af661 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.902125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeae42a-364c-4eab-b004-a82ad22af661 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.904068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 435/878] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:35.910033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb9dd-30dd-43d8-a64d-242d901d99bc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.910928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb9dd-30dd-43d8-a64d-242d901d99bc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.911452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb9dd-30dd-43d8-a64d-242d901d99bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.911633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ce42-40bf-4248-9175-98ae2aaea57d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:35.935304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6b2bb9dd-30dd-43d8-a64d-242d901d99bc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:35.937314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6b2bb9dd-30dd-43d8-a64d-242d901d99bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:35.942664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:35.963694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:35.964315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:35.964597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:35.964875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:35.966871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=52c2cce5fd744ac9a278955e1ae3bc8a) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:35.967288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:35.969139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:35.984040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 444/879] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:35 2022] GET /identity/v3/role_assignments?user.id=52c2cce5fd744ac9a278955e1ae3bc8a&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:36.058319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 436/880] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:36.083822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:36.217295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61d1e-c944-4a69-8fa5-599d830e4f7e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:36.271234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:36.271922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:36.272244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:36.272514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:36.273264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:36.274662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4fbd0-f68a-44b6-8f85-4d1d42f73d36 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:36.294586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 445/881] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:36 2022] POST /identity/v3/services => generated 269 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:37.483433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f448b-f52d-4e42-8011-3dc422387949 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:37.483946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f448b-f52d-4e42-8011-3dc422387949 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:37.483946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f448b-f52d-4e42-8011-3dc422387949 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:37.485945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 437/882] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:37.491705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:37.492266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:37.492266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:37.510762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:37.511980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:37.558500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:37.593930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 446/883] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:37.617018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f448b-f52d-4e42-8011-3dc422387949 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:37.680650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:37.733723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f448b-f52d-4e42-8011-3dc422387949 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:37.771012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:37.771841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:37.772155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:37.772428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:37.773095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:37.774498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:37.787629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:37.788727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:37.789556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 438/884] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:37.795438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:37.918082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406fa11-5f10-4683-8f98-d3cdead1c977 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:37.959187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:37.960337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:37.960817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:37.961306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:37.962262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:37.962769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:37.964544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:37.971262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 447/885] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:37.979810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:38.182859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cee97-1956-4f2a-a362-40ca65c76192 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:38.219920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:38.244423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:38.245168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.245580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.246042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.247003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:38.247412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:38.250080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96242-12ee-47cd-9117-c5c74f8d75d3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:38.260059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 439/886] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:38.268029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:38.327527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:38.453258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd1fc4-b0e2-4b17-aaff-4f2c1c26828f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:38.480848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d653f-064a-4015-9a8c-90a3c03edab2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.481650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d653f-064a-4015-9a8c-90a3c03edab2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.481988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d653f-064a-4015-9a8c-90a3c03edab2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.488147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 440/887] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:38.490563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318450f-ecf3-4d91-b333-6e7e5eb49098 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.491227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318450f-ecf3-4d91-b333-6e7e5eb49098 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.491724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318450f-ecf3-4d91-b333-6e7e5eb49098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.514907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7318450f-ecf3-4d91-b333-6e7e5eb49098 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:38.516954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7318450f-ecf3-4d91-b333-6e7e5eb49098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:38.525464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:38.526592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.527092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.527536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.529110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] RBAC: Adding query filter params (interface=public, service_id=a1ce8866f994441bada9e21890086274, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:38.529633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:38.533304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:38.547953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 448/888] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:38 2022] GET /identity/v3/endpoints?service_id=a1ce8866f994441bada9e21890086274&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:38.556653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:38.629694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 441/889] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:38.631354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e40017-8e23-4f94-b9cf-f9223e413dde None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.631644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e40017-8e23-4f94-b9cf-f9223e413dde None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.631920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e40017-8e23-4f94-b9cf-f9223e413dde None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.633286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 442/890] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:38.641320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.641858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.642307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.673188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:38.675634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:38.707656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:38.712722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca05c-ce94-4780-9915-d26ee9d29a59 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:38.754221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:38.754900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:38.755195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:38.755470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:38.756199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:38.757810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:38.765180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 449/891] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:38 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 20:51:38.766367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:38.829317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 443/892] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:38.859550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:38.933554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc89f8-5667-4b21-94b1-07236a306dee None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:38.975400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:38.999104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.001866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.003058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.003658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.006506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.009996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f757d-7ddf-41ea-a269-d72abd42c08a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.043033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 450/893] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:38 2022] POST /identity/v3/services => generated 241 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:39.086006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b910-97dd-4644-9089-6bac7ce7729c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.137838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.138689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.138967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.139237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.152738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:39.156559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e330aa-577c-4b7f-af3c-78e9ca7f939b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.157931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e330aa-577c-4b7f-af3c-78e9ca7f939b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.158422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e330aa-577c-4b7f-af3c-78e9ca7f939b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.160499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 451/894] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:39.161405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:39.162602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:39.163660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 444/895] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:51:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:39.170057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.170753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.171282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.172480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.197496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:39.199711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:39.235392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:39.307953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:39.311083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e58c9-6064-45b9-b7ec-3de5a4b5a7bd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.353721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.354732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.355171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.355598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.356565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:39.357038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.358618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.360731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 452/896] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:39.382445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 445/897] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:39.385506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.389007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.538310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc114fdc-4fd3-420c-b7d3-1910cedee1b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.579625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e932a8a-8d84-423e-ba25-996a6d30a8fd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.587868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.588916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.589306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.589678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.605651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.607707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:39.641740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:39.643591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:39.645476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:39.645476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:39.645476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:39.645476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:39.645910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.645910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.645910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.645910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.646421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.647606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.650393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 446/898] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:39.656334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:39.662759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:39.664019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:39.665027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:39.670837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 453/899] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:39.674033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.682982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:39.702369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:39.814521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69764b73-c6ca-4701-9902-173135fe9cc7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.845752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a36f5-c5c3-4861-ab72-c70b4bbca564 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:39.852496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.853587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.854062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.854560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.855700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:39.856272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.857941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.872105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 447/900] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:39.878599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.892638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:39.894033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:39.894326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:39.894601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:39.895341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:39.896076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:39.897768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:39.908197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 454/901] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:39.911800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:39.985481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.019474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c00267-4b4c-494e-afca-2df1fc838411 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.023525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.061815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdd985-1dba-478d-ac12-dd7662d71398 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.079595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.080932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.081208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.081473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.091741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.095182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.114716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:40.114965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:40.115855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:40.117044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:40.118631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.119142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.119609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.120625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:40.121216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.121319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 448/902] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:40.122169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:40.123267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.137235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 455/903] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:40.138884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:40.272632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c339-1dd4-4cc5-9ac4-22d33e3adb9d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.288481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a561-0bf7-41cb-9b12-fce472b1501a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.309498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.310612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.311088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.311552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.312577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] RBAC: Adding query filter params (interface=public, service_id=89f3c465f9264ab38a4160c20c625c05, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:40.313154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.314964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.325319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 456/904] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:40 2022] GET /identity/v3/endpoints?service_id=89f3c465f9264ab38a4160c20c625c05&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:40.327206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:40.329323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.330327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.331019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.332344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.336813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:40.337881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.339494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.340345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.363771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.364393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 449/905] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:40.374750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:40.491609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297d7e-3a45-4390-aa12-e53e514ce70e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.529699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacea14-01c0-4def-aaf7-189a8f75f56b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:40.541074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.541837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.542190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.542526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.543323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.549441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.563808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 457/906] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:40 2022] GET /identity/v3/services => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 20:51:40.598484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:40.599481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:40.599948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:40.600461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:40.713132 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.725349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:40.727161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:40.859157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 450/907] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 20:51:40.865167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:40.950187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:40.989291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edb0a8-b414-483b-a8cf-893a9253525d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:41.029430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:41.030241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.030517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.030782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.054110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:41.056912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:41.092183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:41.093196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:41.094254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:41.094254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:41.094254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:41.094254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:41.095377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 458/908] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:41.101190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.210548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:41.221471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d67709-4749-40a0-8996-619768952d78 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:41.263806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:41.264516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.264797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.265069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.265807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:41.266164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:41.267642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:41.290589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 451/909] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:41.296098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.435453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d298-c174-4fc8-96bf-1c1d04582589 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:41.462490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:41.475477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:41.476583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.477042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.477473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.485868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:41.487620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-97e3dd7f-a9b2-4d8a-bfb6-6f73c04710b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:41.503935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:41.505261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:41.506361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:41.508786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 459/910] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:41.518654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.602459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890051-86ac-4afc-95df-aa47045df6b3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.603150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890051-86ac-4afc-95df-aa47045df6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.603664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68890051-86ac-4afc-95df-aa47045df6b3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.606700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 460/911] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:41.611810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.612208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.612551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.630645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:41.631980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:41.693730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a824b-4af6-4002-85c6-276eac5524ac None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:41.716339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 461/912] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:41.736382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.758106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:41.759549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.760397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.761402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.764205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:41.765101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:41.768261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:41.793246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 452/913] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:41.803048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.833729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:41.860356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57079e1c-f00c-494a-a016-80ef137e52a5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:41.877208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:41.899691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:41.900562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.900852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.901126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.901794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:41.903213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8e5be1e0-2e6b-486d-ac52-c2a6eec8a282 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:41.916681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:41.918534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 20:51:41.920665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:41.924204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 462/914] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:41.925757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515107cb-eb2d-4d2c-975b-5a8a757c3d77 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:41.926049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515107cb-eb2d-4d2c-975b-5a8a757c3d77 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:41.926324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515107cb-eb2d-4d2c-975b-5a8a757c3d77 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:41.932044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 463/915] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:41.932044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515107cb-eb2d-4d2c-975b-5a8a757c3d77 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:41.984864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e962-3629-472c-8e48-80bb3e43c9fb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.038869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.039658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.040041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.040372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.041300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] RBAC: Adding query filter params (role.id=c7a7af7c994f4152a13a6683b90973d5, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=52c2cce5fd744ac9a278955e1ae3bc8a) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:42.041665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.043235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d235-5256-404a-90fc-b8365a4525b7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.064867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 453/916] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/role_assignments?user.id=52c2cce5fd744ac9a278955e1ae3bc8a&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=c7a7af7c994f4152a13a6683b90973d5 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:42.064867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.064867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.064867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.089197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:42.091095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:42.122140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515107cb-eb2d-4d2c-975b-5a8a757c3d77 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.175119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.177792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.178490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.179117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.180541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:42.181236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.184081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.193548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 464/917] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:42.206054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:42.214395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 454/918] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:42.241639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:42.254398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:42.285736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:42.392983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161530-2cdd-45e6-8f70-f1f6cc6c85c5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.426376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368923a6-3306-41aa-b4fb-8f75cd8a506b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.448087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.449158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.449628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.450107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.451410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:42.451943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.454605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.464065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 465/919] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Jun 6 20:51:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:42.473962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:42.497906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.499360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.499653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.499928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.500808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.503050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:42.522149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:42.523459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:42.524669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:42.528104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 455/920] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:42.530951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:42.638274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e690e9-3f17-42fa-bcb9-2aaacbc143dd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.652241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:42.666058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:42.701273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.702408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.702959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.704295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.705527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.707914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.726460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99eef-309c-4f78-b68c-0fa60a213481 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:42.760434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 466/921] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:51:42.799053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:42.799814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:42.800321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:42.800817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:42.802210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:42.802736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:42.805136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:42.814091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 456/922] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:42.824114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:42.998177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4b97b-6516-4596-9666-75fb2a4f202d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:43.042771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:43.043910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.044396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.044830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.045753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:43.046238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:43.048029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:43.059038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 467/923] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:43.062423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:43.212742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03b1c-01ea-47b4-bd41-53fa8d6f826d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:43.248581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:43.255276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:43.256092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.256383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.256658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.257722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] RBAC: Adding query filter params (interface=public, service_id=53e3a939717547efb63275de873ceb56, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:43.258011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:43.259698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efa46c-6a30-463e-b6f2-4ff6fa6885d2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:43.270918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 457/924] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:43 2022] GET /identity/v3/endpoints?service_id=53e3a939717547efb63275de873ceb56&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:43.272522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:43.305689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:43.348158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428419a7-df9c-475c-a3dd-b5b9ae39431c None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.348668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428419a7-df9c-475c-a3dd-b5b9ae39431c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.349148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428419a7-df9c-475c-a3dd-b5b9ae39431c None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.351411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 458/925] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:43.371092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.371533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.371981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.394833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799ab7-eb6e-4c19-b1ce-68d913c4e5ec None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:43.404133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:43.406278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:43.462382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:43.463070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.463509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.463793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.464914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:43.466933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:43.486611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 468/926] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:43 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 20:51:43.534914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 459/927] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:43.571552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:43.744649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:43.749869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1ea9-bae6-4f11-9a5c-7caacd3f82bd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:43.818486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:43.819473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:43.819937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:43.820449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:43.821145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:43.823194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:43.843644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:43.845034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 20:51:43.846349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:43.848187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 469/928] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Jun 6 20:51:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:43.865831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:44.022416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3337b-e2f3-44c1-8cb0-f1b641d86ef1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:44.071674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:44.072397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:44.072685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:44.072964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:44.073864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:44.074155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:44.075594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:44.081725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 460/929] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:44.082504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:44.090182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:44.225846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e330b5-e65e-4878-a1e8-e4ed204aaeac None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:44.268629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:44.269374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:44.269616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:44.269891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:44.270613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:44.270921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:44.272388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c85e-a3ea-4440-b852-1f1bb4a09684 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:44.283568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 470/930] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:44.285093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:44.410108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad85c2-789f-43e3-9fd9-a68fc33267ae None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:44.449787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:44.450470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:44.450748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:44.451019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:44.451791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:44.453222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17667d83-0d9f-4798-9643-02db43fd351a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:44.477204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 461/931] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:44.881042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830438-89da-4101-8bb6-41e51cdf02f3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:44.881460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830438-89da-4101-8bb6-41e51cdf02f3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:44.881669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830438-89da-4101-8bb6-41e51cdf02f3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:44.884690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 471/932] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:44.892536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:44.893069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:44.893306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:44.919829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:44.921836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:45.002280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.066468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 462/933] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:45.104791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830438-89da-4101-8bb6-41e51cdf02f3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.144361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.265296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830438-89da-4101-8bb6-41e51cdf02f3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:45.305012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:45.306296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.306802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.307310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.319694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f9852c3b-be6d-42f4-8fb5-d2031491815c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:45.329016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:45.330076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:45.330922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.333876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 472/934] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:51:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:45.342843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.407970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64179e-db32-4d5e-82a6-2607bee43751 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.408244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64179e-db32-4d5e-82a6-2607bee43751 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.408485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64179e-db32-4d5e-82a6-2607bee43751 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.410087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 473/935] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:45.415473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.415758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.416056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.435449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:45.436849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:45.496089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502fef8-fe33-493a-ada0-ab623f0048b6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:45.529002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 474/936] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:45.543886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:45.545012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.545496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.545802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.546806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:45.547521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:45.550347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:45.551972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.562615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.567514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 463/937] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:51:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:45.575852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.625074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.693852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff9b41-f4aa-480b-acc7-9730d04f670b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:45.725969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91b84-7751-46fc-bc17-2133b6c7a89e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:45.740764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:45.741133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.741387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.741665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.742391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:45.744258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:45.745690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING keystone.server.flask.common [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 06 20:51:45.767315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.sql.core [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 20:51:45.767315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 20:51:45.767315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [parameters: {'id': '65662b7674b74c31945c7f8ee1e4bb1b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 20:51:45.767315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80313) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 20:51:45.774377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:45.775561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:45.777379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:45.777379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65662b7674b74c31945c7f8ee1e4bb1b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65662b7674b74c31945c7f8ee1e4bb1b. Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:51:45.777567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result.read() Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 06 20:51:45.778358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application yield resource Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise self.value Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application session.commit() Jun 06 20:51:45.779323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.session.flush() Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application compat.raise_( Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 20:51:45.780267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 20:51:45.781206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application result.read() Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:51:45.782075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [parameters: {'id': '65662b7674b74c31945c7f8ee1e4bb1b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.782946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:45.785115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65662b7674b74c31945c7f8ee1e4bb1b. Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:45.787183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 475/938] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Jun 6 20:51:45 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:45.788440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.801494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:45.803483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:45.824415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:45.825400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:45.826300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:45.826300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:45.826300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:45.826300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:45.829079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 464/939] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:45.836144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:45.868798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.939487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca99b4d-59f5-4d78-9019-c4282c3c186f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:45.958658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:45.981285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a5ce-7255-4773-b2a8-e2440ed25b52 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.019876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.020962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.021420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.021810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.033979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.039169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.040063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.040519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.040935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.041808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:46.042263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.043780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.050747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:46.072025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:46.073521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 476/940] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:46.075012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.076551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 465/941] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:46.079660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.192764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0575d1-3c9a-40fa-a003-d368a0acbf4d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.226251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.240148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f99445-1c3c-4233-ac45-88d4fe28c8b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.249539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.251144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.251625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.252074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.253436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:46.253900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.256103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c026fa6-a676-4a37-b672-a15721350bc9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.280642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.281699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.282103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.282472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.286657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 477/942] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:46.301490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.303106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.322271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd53-7c3d-4e1b-9a2a-53e7bc2fa936 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.322610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd53-7c3d-4e1b-9a2a-53e7bc2fa936 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.322853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd53-7c3d-4e1b-9a2a-53e7bc2fa936 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.324826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 478/943] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:46.325067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:46.326042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:46.327018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 466/944] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:46.333566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.334354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.334933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.335377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.339174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.363175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:46.365801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:46.460267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566edcd-6d89-4de9-9331-98512c85786b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.468379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 479/945] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:46.493700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.510392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.511919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.512687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.513118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.514452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:46.514916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.517119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.541329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 467/946] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:46.547268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.620552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadedcce-45dd-4665-b1d0-82d267516812 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.624102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.640363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.668242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.669621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.670152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.670613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.671462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.673347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.683063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d387e-ed1a-4985-aeb7-bcdb1ffd8777 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:46.686656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:46.688048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:46.692881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 480/947] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:46.698792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.737684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.738524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.738806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.739090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.752926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.754915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:46.778490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:46.779521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:46.780466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:46.780466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:46.780466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:46.780466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:46.784146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 468/948] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:46.787531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.834440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb79009-3ffa-44bb-80b2-3555600116b3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.880343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.881454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.881937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.882441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.883354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:46.883857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.885736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.891765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 481/949] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:46.897705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:46.911421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0c03d-e713-4360-8886-6ebdf3d82a3e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:46.932665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.959825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:46.961673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:46.963221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:46.963679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:46.964125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:46.965242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:46.966076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:46.968413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:46.990361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 469/950] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:46.992770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.034473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4feca-825f-4197-b366-96ee5b48e2ac None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.084325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.085019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.085301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.085574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.086331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:47.086641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.088519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e877d-6eff-4e37-8dde-82546c11dc99 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.095048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 482/951] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:47.096478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4889-d7cb-48e6-9dcc-e461edd6dfbd None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.096712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4889-d7cb-48e6-9dcc-e461edd6dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.097018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4889-d7cb-48e6-9dcc-e461edd6dfbd None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.098513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 483/952] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:47.104295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.104646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.104822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.123186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e4762-acc1-431d-80eb-1b5a4f425e86 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.130280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:47.132361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:47.162430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.163305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.163584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.163878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.171351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.173034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:47.188034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:47.189061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:47.190148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:47.194321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 470/953] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:47.195226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.235370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:47.256040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 484/954] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:47.256040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.308680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:47.322991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa88ce0-da39-4ad6-8734-72ee19bb7a29 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.377540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.378660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.379159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.379568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.380379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.381782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.386740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d686f-fa3a-4be4-8565-3d819c889be0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.417518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 471/955] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:47.417518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.459714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.460977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.461512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.462029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.463502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:47.464184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.467124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.496746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 485/956] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:47.500478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.621182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:47.645554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca5b3-71b0-454a-b55d-e06d5acd5ec6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.680135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:47.699507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9365aec-1f9e-4494-b007-45c478805f83 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.710698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.712366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.712805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.713254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.714647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.717434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:47.742548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:47.744109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:47.745575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:47.748454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 472/957] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:47.748903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.749994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.750600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.750600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/52c2cce5fd744ac9a278955e1ae3bc8a/roles/c7a7af7c994f4152a13a6683b90973d5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.754231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=52c2cce5fd744ac9a278955e1ae3bc8a, role_id=c7a7af7c994f4152a13a6683b90973d5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.756180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.757368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:47.777406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 486/958] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:51:47 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/52c2cce5fd744ac9a278955e1ae3bc8a/roles/c7a7af7c994f4152a13a6683b90973d5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:51:47.934684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a3529-3400-474b-9fae-1390c74ef633 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:47.978419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:47.979110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:47.979390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:47.979669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:47.980457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:47.980767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:47.982288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41ef7d-f357-49a4-8265-93f5bb62225a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:47.989086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 473/959] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:47.995212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:48.115012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ead3d-1f21-43a2-9f9a-ca2f54f23fe0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:48.155808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:48.156577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:48.157591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:48.157876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:48.158618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:48.158926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:48.160385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa068d-5bdd-4296-8ef1-d29fa0cacb5f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:48.166420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 487/960] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:48.836777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db59-c3f3-4038-acf9-54549acceb05 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:48.837508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db59-c3f3-4038-acf9-54549acceb05 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:48.837782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db59-c3f3-4038-acf9-54549acceb05 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:48.839359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 474/961] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:48.846555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:48.847063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:48.847182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:48.865843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:48.867065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:48.880634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:48.950080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 488/962] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:48.974696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323db59-c3f3-4038-acf9-54549acceb05 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:49.000375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:49.107186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323db59-c3f3-4038-acf9-54549acceb05 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:49.150955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:49.151735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:49.152107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:49.152419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:49.153329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:49.155127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:49.157736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING keystone.server.flask.common [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 06 20:51:49.174361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.sql.core [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 20:51:49.174361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 20:51:49.174361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [parameters: {'user_id': '36f2595b788649a9b47c60c646aa7ca9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 20:51:49.174361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80314) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 06 20:51:49.194808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:51:49.196129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application yield resource Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise self.value Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application session.commit() Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 20:51:49.197379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.flush() Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application compat.raise_( Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 20:51:49.198285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 20:51:49.199191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 20:51:49.200745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [parameters: {'user_id': '36f2595b788649a9b47c60c646aa7ca9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:49.202910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 06 20:51:49.204934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:49.207224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 475/963] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Jun 6 20:51:48 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:49.208241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:49.320786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e5a0e-5988-42e6-b459-3761fcb2b1c2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:49.383517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:49.384423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:49.384702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:49.384972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:49.394467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:49.396080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-af086eca-4996-486d-bc01-8fefaad809e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:49.413183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:49.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:49.417601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 489/964] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:51:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:49.421150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:49.534416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:49.565223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae8414-eb9d-4778-aaf7-81b7585352d6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:49.607654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:49.608467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:49.608828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:49.609102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:49.610255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:49.610562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:49.612394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec78b9-fce1-4b48-b122-1157689c11e5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:49.661998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 476/965] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Jun 6 20:51:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:50.005696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18ab2-bf77-4ac0-9bd7-107733a90954 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.006337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18ab2-bf77-4ac0-9bd7-107733a90954 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.006337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18ab2-bf77-4ac0-9bd7-107733a90954 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.008291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 490/966] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:50.018878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.019508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.019508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.044023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:50.044023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:50.132640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 477/967] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:50.159521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b18ab2-bf77-4ac0-9bd7-107733a90954 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.180416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:50.287873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b18ab2-bf77-4ac0-9bd7-107733a90954 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:50.332137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:50.332967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.333310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.336020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.336020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:50.336020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-018fe1b3-ffc6-4045-86ac-31f6de47cca1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:50.350484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:50.351576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:50.352484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 491/968] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:50.361216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.379491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de35d6-1af3-4df3-89ce-127d929ec934 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.380138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de35d6-1af3-4df3-89ce-127d929ec934 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.380570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de35d6-1af3-4df3-89ce-127d929ec934 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.382280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 492/969] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:50.388752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.389320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.389836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.411983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:50.413679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:50.456890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:50.497131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b5d88-cb18-4c01-9936-afa1574fd4fa None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:50.497995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:50.510659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 493/970] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:50.529427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.555497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:50.556428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.556717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.557266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.558488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:50.559328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:50.564383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:50.570022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 478/971] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:50.575740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.675554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11c19-4fd4-4c5b-9db9-c0988f2526b1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:50.713305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9c2c-7dca-4d98-bd4b-ff9728ae349a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:50.722519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:50.723878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.724330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.724816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.742201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-fdc434cc-d5e9-475e-aef2-abd6fb0b53f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:51:50.751053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:50.752649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:51:50.753606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:50.754427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:50.754548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 494/972] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:50.754548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b43f-68af-457e-ac63-6f407d1aaf49 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.754548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b43f-68af-457e-ac63-6f407d1aaf49 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.754867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b43f-68af-457e-ac63-6f407d1aaf49 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.756021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 495/973] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:50.760999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3b43f-68af-457e-ac63-6f407d1aaf49 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.763712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:50.764867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.765213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.765528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.766790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:50.767106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:50.769176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930855-b9c0-4adf-94b8-fae1d67e45fc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:50.781079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 479/974] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:50.781079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.781079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.781079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.799440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:50.800699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:50.833695 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:50.882476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 480/975] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:50.883852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:50.885524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3b43f-68af-457e-ac63-6f407d1aaf49 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:50.927195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:50.927886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:50.928184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:50.928459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:50.929221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:50.929525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:50.930931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:50.940587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 496/976] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:50.941441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.025996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f52b3e-e58e-4ab9-82fa-e22337d9d8ec None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.059096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d90d-8554-4018-9d60-4fa17a8d7062 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.062652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:51.072818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.073493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.073776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.074047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.074864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] RBAC: Adding query filter params (interface=admin, service_id=53e3a939717547efb63275de873ceb56, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:51.075175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.076629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.083344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 481/977] 10.222.0.33 () {56 vars in 1249 bytes} [Mon Jun 6 20:51:50 2022] GET /identity/v3/endpoints?service_id=53e3a939717547efb63275de873ceb56&interface=admin®ion_id=RegionOne => generated 193 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:51.084143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:51.084275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.103469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.104461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.104751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.105023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.105758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.107156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.123174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 497/978] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:50 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:51.124057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.226384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b89e29-9971-4a8e-95e0-b35a58d9fb90 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.281633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.282552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.282834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.283113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.285547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce74f-d89d-4dd4-b440-deec2a072296 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.295320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.296924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:51.317272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:51.321112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:51.322705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:51.322705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:51.322705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:51.322705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:51.322705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 482/979] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:51.326764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.343076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.343678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.344062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.344295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.345006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.346453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.354374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 498/980] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/services => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 20:51:51.388647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:51.472290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2ae7-a65f-44a2-a431-319a1ae284bf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.513246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.514202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.514626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.515075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.516058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:51.516534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.518171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.533291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 483/981] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:51.538891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.588758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:51.650795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd959d5-97ef-4e54-941b-0e9a512a37e9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.689172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.690016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.690291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.690559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.699134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.700635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:51:51.716672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:51.718126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:51.719680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 499/982] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:51.724893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:51.842116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:51.847476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338afe-21e9-4984-a6a1-41b80c8bcf08 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:51.887918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:51.888798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:51.889175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:51.889562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:51.890509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:51.891138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:51.892719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:51.917431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 484/983] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:51.918663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:52.034334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ea38-574b-4ed0-8de8-a698ef34bf56 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:52.039060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:52.080904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:52.081599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:52.081856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:52.082107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:52.163611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:52.165282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:52.276831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 500/984] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:51:51 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:51:52.277945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:52.382882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cedf1-47bd-4a4d-9db1-52b9d028214b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:52.417931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:52.418739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:52.419016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:52.419282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:52.429718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:52.431185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:51:52.449259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:52.450227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:52.456240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:51:52.456240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:51:52.456240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:51:52.456240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:52.456240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 485/985] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:52.456605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:52.458652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:52.565588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49c02-435e-43e3-b6df-9a5da6a15044 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:52.600938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:52.601620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:52.601903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:52.602180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:52.602906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:52.603213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:52.604647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:52.621516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 501/986] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:52.623184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:52.634589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:52.726906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7474dd-d0f8-483d-9749-cb510937a770 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:52.762148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:52.762965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:52.763250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:52.763525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:52.770910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:52.772398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:51:52.786326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:52.787276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:52.788366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 486/987] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:52.793611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:52.858371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:52.900635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933f7ab-3806-4511-9c42-9c63a7ca799f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:52.934498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:52.935175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:52.935456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:52.935737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:52.936553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:52.936861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:52.938410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51ae1-7328-439a-98fc-356f7d9faeb8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:52.951437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 502/988] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:52.957360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:53.026803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:53.067931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a5bb7-3389-4a78-b19b-db025605543b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:53.106635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:53.107345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.107665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.107977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.108942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] RBAC: Adding query filter params (role.id=c7a7af7c994f4152a13a6683b90973d5, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=52c2cce5fd744ac9a278955e1ae3bc8a) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:53.109234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:53.110822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24316ec-cb58-45ca-ad37-76ad2a932fc0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:53.117940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 487/989] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:51:52 2022] GET /identity/v3/role_assignments?user.id=52c2cce5fd744ac9a278955e1ae3bc8a&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=c7a7af7c994f4152a13a6683b90973d5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:53.490078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62183b-d5f0-48ad-9357-fb97c8890507 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.490600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62183b-d5f0-48ad-9357-fb97c8890507 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.490600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62183b-d5f0-48ad-9357-fb97c8890507 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.492178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 503/990] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:53.497939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6608b1-ad35-42d2-9eeb-f8eb5991c136 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.498377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6608b1-ad35-42d2-9eeb-f8eb5991c136 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.498567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6608b1-ad35-42d2-9eeb-f8eb5991c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.518005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fc6608b1-ad35-42d2-9eeb-f8eb5991c136 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:53.519232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fc6608b1-ad35-42d2-9eeb-f8eb5991c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:53.594742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 488/991] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:53.618097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62183b-d5f0-48ad-9357-fb97c8890507 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:53.708544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f33de-ab6e-4f1f-9f5b-6284abe728a7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.708870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f33de-ab6e-4f1f-9f5b-6284abe728a7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.709109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f33de-ab6e-4f1f-9f5b-6284abe728a7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.710639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 489/992] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:53.716592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.717417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.717719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.729874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62183b-d5f0-48ad-9357-fb97c8890507 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:53.736622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:53.737830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:53.756202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:53.772840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:53.773680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.773981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.774256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.774911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:53.777613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:53.793283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:53.794527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:53.795386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:53.796175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 504/993] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:53.801365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:53.803952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:53.814982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 490/994] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:53.838133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:53.921699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa169d-d5f2-48e8-b51b-4fc0508b3bc2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:53.940072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6537c-2243-465a-8541-15a2480f4bb4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:53.960213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:53.960952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.961231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.961502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.962239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:53.962541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:53.964132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:53.975273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 505/995] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:53.977225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:53.987474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:53.988366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:53.988649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:53.988925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:53.989604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:53.991012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:54.003851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:54.008109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:54.009057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 491/996] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Jun 6 20:51:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:51:54.011040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:54.042318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:54.078552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:54.093498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536adfb0-89a9-481d-baf3-84086b44a913 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.129610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36738d26-cd03-4b14-b833-cfe927fbb390 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.131003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.131684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.131967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.132325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.133029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:54.133341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.134726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.140037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 506/997] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:54.146435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:54.173403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.174122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.174404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.174675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.175390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:54.175701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.177117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.182185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 492/998] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:54.188492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:54.257735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6cda-6bc3-4381-89b2-b7ace34768ec None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.272977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:54.299687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.299967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb498a8c-9cec-454d-bd6d-5c51cb79aead None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.300423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.300705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.300977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.301805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] RBAC: Adding query filter params (interface=public, service_id=7c6c4cac7e7c44fb9b062c08fd7e0a25, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:54.302113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.303593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.309893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 507/999] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:51:54 2022] GET /identity/v3/endpoints?service_id=7c6c4cac7e7c44fb9b062c08fd7e0a25&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:54.315601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:54.328212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:54.346533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.347403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.347516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.347742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.348478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:54.348780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.350310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.356305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 493/1000] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Jun 6 20:51:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:54.364208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:54.430909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe232-41dd-4275-bd6d-b9cbca2793a2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.473032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.474309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.475132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.475827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.476980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.479199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7f27-270a-4969-bd7f-8236e3c6913a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.480402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374b2b-6802-4c82-90ce-564fce2bfb3f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:54.500248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 508/1001] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:51:54 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 20:51:54.521154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:54.521921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:54.522136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:54.522409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:54.523240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:54.524673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb3e4-5a6e-498a-b57a-1abe0df3915d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:54.543919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 494/1002] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:51:55.481196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7726-1377-449a-a74f-5cf2732ce84c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:55.481461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7726-1377-449a-a74f-5cf2732ce84c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:55.481697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b7726-1377-449a-a74f-5cf2732ce84c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:55.483180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 509/1003] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:55.489705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:55.490039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:55.490276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:55.508774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:55.509996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:55.557829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:55.597821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 495/1004] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:55.625001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b7726-1377-449a-a74f-5cf2732ce84c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:55.684295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:55.752408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b7726-1377-449a-a74f-5cf2732ce84c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:55.791131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:55.792265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:55.793953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:55.793953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] PATH_INFO: `/v3/services/image` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:55.794484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:55.796971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:55.810110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:55.811173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:51:55.812738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:51:55.816647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 510/1005] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 6 20:51:55 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:55.818141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:55.934905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b170df-bb41-4346-a2ae-f6b5bcc7876c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:55.978757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:55.979436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:55.979712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:55.979977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:55.980714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] RBAC: Adding query filter params (name=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:55.981013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:55.982394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b6e7-3d24-4afb-8cc7-28efd7397642 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:55.991512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 496/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:55.998742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:56.140576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7544f-b927-4bc3-aa21-82e1650df82b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:56.149506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:56.194609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:56.195300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:56.195568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:56.195854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:56.196598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] RBAC: Adding query filter params (type=image) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:56.196899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:56.198319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ae11d-37c1-4e5b-b419-369711c71d97 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:56.203897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 511/1007] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:56.815846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24016a-bf7b-4964-bd13-9346fa3a47a0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:56.816433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24016a-bf7b-4964-bd13-9346fa3a47a0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:56.816433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24016a-bf7b-4964-bd13-9346fa3a47a0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:56.817771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 497/1008] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:56.823480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754244f9-c1ef-4fc2-8fdf-1f93717ee22b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:56.823944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754244f9-c1ef-4fc2-8fdf-1f93717ee22b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:56.824181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754244f9-c1ef-4fc2-8fdf-1f93717ee22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:56.841932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-754244f9-c1ef-4fc2-8fdf-1f93717ee22b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:56.843144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-754244f9-c1ef-4fc2-8fdf-1f93717ee22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:56.915289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 512/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:56.938595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24016a-bf7b-4964-bd13-9346fa3a47a0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:56.977553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:57.038284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786f63-e44c-4adf-9d85-5cafdbfc0b79 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.038284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786f63-e44c-4adf-9d85-5cafdbfc0b79 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.038284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786f63-e44c-4adf-9d85-5cafdbfc0b79 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.038284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 513/1010] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:51:57.043182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.043447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.043728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.059705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24016a-bf7b-4964-bd13-9346fa3a47a0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.064444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:57.065641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:57.095910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.096657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.096936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.097207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.097864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.099249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:51:57.111227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:51:57.112477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:51:57.118345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 498/1011] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:51:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:51:57.119240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:57.144551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 514/1012] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:51:57.167522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:57.198507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:57.222198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:57.226999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02232-9d5a-444c-9b00-db205d4746e8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.266904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.267880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.268194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.268474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.269193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:57.269500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.270895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.282137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 499/1013] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:57.282507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887bd4b-ce12-44c3-8642-73dba26f3631 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.282992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:57.316837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.317816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.318107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.318698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.320214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.321880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.329199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 515/1014] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:51:57.331002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:57.396534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d2b9-bb19-402b-8184-c5fecd2ef3eb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.434040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.434831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.435109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.435379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.436131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:51:57.436433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.437860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.446396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 500/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Jun 6 20:51:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:51:57.451308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:57.465003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:57.469769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334ec75-205e-4aa0-a5e1-9b4432268eed None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.486559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:51:57.513232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.513911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.514178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.514455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.515165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.516799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c412437-23ff-4e35-969a-65fb48903cce None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.553481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 516/1016] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:57 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:57.579183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110ac-c536-426e-bf45-0ddda1545c33 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:57.620822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:57.621519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:57.621802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:57.622077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:57.622855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:57.624338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4544b0-194c-448f-9db2-e983844d3ba7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:57.649950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 501/1017] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:51:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:51:58.527044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53d627-9457-4595-b215-4c08be4326f9 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:58.527665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53d627-9457-4595-b215-4c08be4326f9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:58.527665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53d627-9457-4595-b215-4c08be4326f9 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:58.529043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 517/1018] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:58.535145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7f7f-f66a-432e-8436-abd202c7d488 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:58.535725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7f7f-f66a-432e-8436-abd202c7d488 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:58.535725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7f7f-f66a-432e-8436-abd202c7d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:58.555210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b7cb7f7f-f66a-432e-8436-abd202c7d488 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:58.556492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b7cb7f7f-f66a-432e-8436-abd202c7d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:58.641489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 502/1019] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:58 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:51:58.664505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53d627-9457-4595-b215-4c08be4326f9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:51:58.774508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53d627-9457-4595-b215-4c08be4326f9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:51:58.810647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:51:58.811315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:58.811606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:58.811899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:58.812703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:51:58.814261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4efb8-9b74-4094-9e34-a2fa0127b293 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:51:58.836047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 518/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:51:58 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:51:59.907837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ddbf-ed93-4a4f-b016-1a1d0bbbd980 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:59.908486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ddbf-ed93-4a4f-b016-1a1d0bbbd980 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:59.908486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734ddbf-ed93-4a4f-b016-1a1d0bbbd980 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:59.909980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 503/1021] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:51:59.915576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386055-fdb7-4227-8552-89e528833748 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:51:59.916136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386055-fdb7-4227-8552-89e528833748 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:51:59.916136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33386055-fdb7-4227-8552-89e528833748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:51:59.933127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-33386055-fdb7-4227-8552-89e528833748 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:51:59.934314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-33386055-fdb7-4227-8552-89e528833748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:51:59.937200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.015534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 519/1022] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:51:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:52:00.040402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734ddbf-ed93-4a4f-b016-1a1d0bbbd980 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.054332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.143045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8184-8221-46c8-8ba5-6c95f92b5027 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.143377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8184-8221-46c8-8ba5-6c95f92b5027 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.143632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8184-8221-46c8-8ba5-6c95f92b5027 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.145237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 520/1023] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:52:00.150294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.150575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.150885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.154204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734ddbf-ed93-4a4f-b016-1a1d0bbbd980 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.168258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:00.169492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:00.191780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.192620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.192902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.193174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.194376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:00.195839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:00.202155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 504/1024] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:00.203413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.240286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 521/1025] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:52:00.264223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.294802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.322741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984cdfb-6264-4f60-92ef-808d57594b0a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.337291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.362763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.363456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.363738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.364658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.365434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:00.367102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:00.379741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47783e-2f9a-4fb6-b1d6-5c2f13e01771 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.392434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 505/1026] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:52:00 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:52:00.419422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.420246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.420533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.420811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.433548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:00.442128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:00.443274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:00.449621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 522/1027] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:52:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:00.452162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.573237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543d58e-24ed-42c6-9e83-6e30b01c247b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.606669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.614774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.615474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.615781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.616076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.616848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:00.617165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:00.618828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:00.632096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 506/1028] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:52:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:00.634284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.752824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1e865-1d81-4782-8411-9ce362a02cc4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.782689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:00.793403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.794226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.794504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.794790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.808252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:00.809826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:00.832151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:00.833173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:00.834056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:00.834056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:00.834056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:00.834056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:00.834056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 523/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:00.839531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:00.948026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310148f6-f55d-4236-a23b-5c2a9d8042e8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:00.985240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:00.985913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:00.986193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:00.986475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:00.987204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:00.987511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:00.988924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa7fa-44b1-4926-89aa-a5abfca0f7f7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.002068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 507/1030] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:01.008346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.130564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8f9fe-c523-47eb-a0d6-cfa6b3a67df5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.154789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc58b4-3cf1-4cf0-a05f-333fa526d46d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.155274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc58b4-3cf1-4cf0-a05f-333fa526d46d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.155453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc58b4-3cf1-4cf0-a05f-333fa526d46d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.157183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 508/1031] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:01.162884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.163173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.163452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.171036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.172006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.172298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.172675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.181807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.182433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:01.183258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.183801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:52:01.199265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:01.200908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:01.202403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 524/1032] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:01.206130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.248085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.257185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.272253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 509/1033] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:01.293150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.322817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197beb-39f4-4f58-92c7-64584853f3d2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.361094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.361759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.362034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.362302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.363142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:01.363441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.365236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.386064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 525/1034] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:01.391646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.403552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19d497-ca7d-41bb-97f2-c342d00bdecd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.442661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.443465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.443742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.444028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] PATH_INFO: `/v3/services/image` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.444692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.446093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:01.462875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:01.464203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:01.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:01.466230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 510/1035] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:01.472567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.515547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.523322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce07d6-a18e-40b5-88c9-6e06a0370235 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.534904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.574999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.575691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.575984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.576314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.613435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6670046-7f7b-494e-ac6b-773046e08b88 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.655807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.657910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.658191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.658464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.659194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:01.659502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.660953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.664767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.666271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.669756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 511/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:01.672816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.781547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.789656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 526/1037] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:01.794445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.803002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335600-59c6-4cc5-8475-41f610978cf0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.816817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:01.843167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.844075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.844740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.845855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.846575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] RBAC: Adding query filter params (type=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:01.846880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.849149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.854677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 512/1038] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:01.860483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:01.900798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d2c9-b9ae-4f17-a0a3-d6b06351202f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.937286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:01.938964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:01.939267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:01.939547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:01.951080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:01.952813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:01.969780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adccb9-a78a-462f-bc47-a2f6fc26cf6f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:01.970620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:01.971585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:01.972977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:01.972977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:01.972977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:01.972977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:01.972977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 527/1039] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:01.977485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:02.012826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.013831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.013831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.014030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.014827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] RBAC: Adding query filter params (interface=public, service_id=16e31b726cbb4bcab0e446380aa837a4, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:02.015163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.016767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.024088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 513/1040] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/endpoints?service_id=16e31b726cbb4bcab0e446380aa837a4&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:02.029263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:02.030791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:02.083529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6aa6-41f8-405b-832a-1df19adb7d71 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:02.086421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:02.122562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.123257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.123538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.123807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.124568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:02.124927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.126803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.145731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 528/1041] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:02.146851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:02.160494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da050d9-5b82-44c7-8991-a6dd1824a5cb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:02.207243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.208268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.208734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.209007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.209700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.211070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.228024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 514/1042] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:52:02 2022] GET /identity/v3/services => generated 1957 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 20:52:02.278537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03b37-eb6c-43fd-bdf0-a93377bada20 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:02.288955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:02.319434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.320572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.321021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.321444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.330023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.331826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:52:02.349318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:02.350390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:02.351307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:02.356569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 529/1043] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:02.357759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:02.477294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911a6c9-db50-404e-a543-4ea794b2790f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:02.479725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:02.521119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.521835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.522124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.522398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.523196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:02.523507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.524999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bc4ed-7e79-46bd-a81a-71eb6483532b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.542739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 515/1044] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:02.544029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:02.654176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641cc15-43dd-40f5-8494-f22f4d9ea48c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:02.691201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:02.691881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.692196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.692471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.693309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] RBAC: Adding query filter params (role.id=c7a7af7c994f4152a13a6683b90973d5, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:02.693618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:02.695071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974186f1-4461-44a7-a632-32f8f65dcf6a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:02.708037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 530/1045] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:02 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=c7a7af7c994f4152a13a6683b90973d5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:02.781766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62640-f876-4fe2-b356-b5edbcd82c6e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.782116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62640-f876-4fe2-b356-b5edbcd82c6e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.782363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62640-f876-4fe2-b356-b5edbcd82c6e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.783836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 516/1046] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:02.790016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:02.790385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:02.790564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:02.808658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:02.809882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:02.839568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:02.887494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 531/1047] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:02.911466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e62640-f876-4fe2-b356-b5edbcd82c6e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:03.023137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e62640-f876-4fe2-b356-b5edbcd82c6e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:03.062955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:03.063767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:03.064075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:03.064346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:03.075472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:03.083315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:03.084315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:03.090127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 517/1048] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:03.092841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:03.195034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d98b54-76fe-4a94-ae2e-80afa7bbc818 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:03.230831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:03.231506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:03.231786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:03.232087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:03.232830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:03.233128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:03.234689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:03.243735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 532/1049] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:03.249311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:03.276948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:03.354456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aec7d-027f-4104-8933-dd805df0c32c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:03.391439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:03.392353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:03.392625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:03.392891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] PATH_INFO: `/v3/users/af77036082974186be1d8fa4c12c3dd3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:03.407234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] RBAC: Authorizing `identity:get_user(user_id=af77036082974186be1d8fa4c12c3dd3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:03.408678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:03.410648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 518/1050] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:03 2022] GET /identity/v3/users/af77036082974186be1d8fa4c12c3dd3 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:03.416247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:03.442939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:03.525695 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4bc07-54fe-42fd-b46e-45d0f04134cc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:03.560291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:03.560949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:03.561226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:03.561496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:03.628578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:03.630026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:03.653647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:03.734763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 533/1051] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:03.736556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:03.822996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:03.847281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eae718-cfe2-461d-8a5d-c05ca2e7e27c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:03.882982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:03.883859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:03.884172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:03.884447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:03.885646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:03.887093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba46b-3409-445b-85bd-e6b730bd5b43 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:03.888858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 519/1052] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:03 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:03.895166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:04.030278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ae2e-ff92-4468-88b9-41550866224c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:04.064823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:04.077589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:04.078267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:04.078547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:04.078813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:04.080626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=e404eb39a9a640028dba8963461f2d76, user.id=af77036082974186be1d8fa4c12c3dd3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:04.080626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:04.080626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7dae5-1b98-472b-9fd5-2f8bf5433f56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:04.090098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 534/1053] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:03 2022] GET /identity/v3/role_assignments?user.id=af77036082974186be1d8fa4c12c3dd3&scope.project.id=e404eb39a9a640028dba8963461f2d76&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:04.520893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfa80-69d9-4d3b-b2e3-f459bbf3f833 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:04.521430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfa80-69d9-4d3b-b2e3-f459bbf3f833 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:04.521430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfa80-69d9-4d3b-b2e3-f459bbf3f833 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:04.522697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 520/1054] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:04.528552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:04.529026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:04.529129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:04.546461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:04.547840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:04.627377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 535/1055] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:04.650903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccfa80-69d9-4d3b-b2e3-f459bbf3f833 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:04.772269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccfa80-69d9-4d3b-b2e3-f459bbf3f833 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:04.808903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:04.809683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:04.809964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:04.810233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:04.810916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:04.812366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:04.824967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:04.826054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:04.833050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 521/1056] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Jun 6 20:52:04 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:04.833881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:04.939508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c8361-7103-40d2-a135-af1c6e570103 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:04.959972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:04.980817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:04.981518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:04.981805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:04.982082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:04.982810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:04.983122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:04.984627 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec623f-0f02-4b9d-906c-7e76fe68b7d8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:04.990822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 536/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:04.996802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.003461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ad07-9f0d-4fd5-8a16-b06341cefa92 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.003776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ad07-9f0d-4fd5-8a16-b06341cefa92 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.004112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ad07-9f0d-4fd5-8a16-b06341cefa92 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.005530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 537/1058] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:52:05.011408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.011730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.011953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.018111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:05.033701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:05.037602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:05.112271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 538/1059] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:05.127502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0112ec2-bc7f-4934-b1bb-48f8cb088be8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.135776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.173609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.174294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.174572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.174839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.175555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] RBAC: Adding query filter params (type=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:05.175968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:05.177257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:05.184036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 522/1060] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:05.189506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.264266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12bd7-224f-4cd2-b935-a83ed46db482 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.275945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:05.284560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:05.299731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869308-84d8-4a3a-af80-b6d2c9dc2711 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.309922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.310757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.311259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.311377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.322442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:05.331125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:05.332147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:05.333004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 539/1061] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:52:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:05.339238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.344036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.344712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.344995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.345269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.346035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:05.347419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:05.380029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 523/1062] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:52:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:05.464898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dd5c7-af2d-4b13-a415-b497a314f290 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.509690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.510377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.510671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.510941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.511696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:05.512014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:05.513401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:05.523001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 540/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:52:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:05.529137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.637352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720b4a4-8cd1-41fa-9f13-1d3772497941 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.673165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.673972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.674253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.674525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.676729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:05.687106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:05.688805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:05.707166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:05.708160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:05.709049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:05.709049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:05.709049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:05.709049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:05.709049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 524/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:05.715806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.749360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:05.827282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18c145-2087-4493-ab67-7927f7b2e2e8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:05.862571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:05.863242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:05.863520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:05.863782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:05.864546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:05.864845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:05.866213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:05.878837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 541/1065] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:05.884262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:05.985201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96ef7-df16-4f81-8372-258fbadc8ec1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.018693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.019491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.019768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.020067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.029212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.030695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:52:06.049299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:06.050351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:06.051333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:06.055695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 525/1066] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:52:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:06.057067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.160986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.173719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a905-b562-4efc-9aef-7c5e8ce86bdb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.212921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.213636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.213897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.214197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.215034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:06.215339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.217155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02d4d-e881-40f0-b921-c906b2608be5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.241761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 542/1067] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:06.242911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.294748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.353884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99220d-5595-4de2-a08e-5096a9839803 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.367609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aeccd-2f50-4351-9d40-6857e26acfcc None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.367965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aeccd-2f50-4351-9d40-6857e26acfcc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.369692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aeccd-2f50-4351-9d40-6857e26acfcc None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.369784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 543/1068] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:52:06.374856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.375194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.375551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.391951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.392779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.393059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.393328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.393572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:06.394781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:06.404152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.405590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:06.426380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:06.427303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:06.428253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:06.428253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:06.428253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:06.428253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:06.429113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 526/1069] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:06.435072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.480877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 544/1070] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:06.504599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.543442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.548266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c781-3c61-4463-ade5-a8c0b329ba71 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.591565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.592256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.592537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.592817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.593852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:06.594512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.594673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.595925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.608278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 527/1071] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:06.613787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.625074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333a4c-ad62-4977-bd9b-0573b9a86385 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.661538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.662615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.663046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.663497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.675262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:06.683169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:06.684316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:06.685394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:06.687876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 545/1072] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:06.694199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.729112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64211-f889-43c1-9b28-55035e8b3197 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.767772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.768522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.768802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.769079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.776073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.777530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:52:06.793102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:06.794223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:06.795288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 528/1073] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:06.801049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.808682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b10a2-9ff0-4ba3-ac56-d6f991a20293 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.823643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.847663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.848422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.848704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.848969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.849724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:06.850033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.851517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.856976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:06.866999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 546/1074] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:06.867893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.917924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09cfdc-53fc-4ad4-b08a-076af8daea8f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:06.957953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:06.958636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:06.958943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:06.959220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:06.960179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:06.960387 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:06.961788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:06.974992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 529/1075] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:06.980895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:06.984744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74a73-9fad-4746-a2f5-13534b23ec9b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:07.022377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:07.023187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.023468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.023741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] PATH_INFO: `/v3/users/af77036082974186be1d8fa4c12c3dd3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.025236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] RBAC: Authorizing `identity:get_user(user_id=af77036082974186be1d8fa4c12c3dd3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:07.026455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:07.028345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 547/1076] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:06 2022] GET /identity/v3/users/af77036082974186be1d8fa4c12c3dd3 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:07.034002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:07.077226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:07.101240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7265-21bf-43f0-9598-9595bf7e59c8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:07.110694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:07.141225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:07.141972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.142252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.142526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/c7a7af7c994f4152a13a6683b90973d5` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.144817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=4746a0f4669742ba9e03404e04ae0536, role_id=c7a7af7c994f4152a13a6683b90973d5)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:07.146263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:07.148746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334076f-864f-4e27-ab42-ad4599ee8a77 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:07.162286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 530/1077] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:52:06 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/4746a0f4669742ba9e03404e04ae0536/roles/c7a7af7c994f4152a13a6683b90973d5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 20:52:07.198352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:07.199584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.200104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.200556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.202066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:07.204783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8fc6-5200-454e-8c13-ed346f9a2a62 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:07.207384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 548/1078] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:07 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:07.213519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:07.339461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8813d-d09d-41e1-8abe-cc46f2cdf3b9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:07.395807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:07.395807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.395807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.395807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76/users/af77036082974186be1d8fa4c12c3dd3/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.398185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] RBAC: Authorizing `identity:create_grant(project_id=e404eb39a9a640028dba8963461f2d76, user_id=af77036082974186be1d8fa4c12c3dd3, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:07.399702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575d3da-f528-4225-a416-6a059402ba81 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:07.411785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:07.419181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 531/1079] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:52:07 2022] PUT /identity/v3/projects/e404eb39a9a640028dba8963461f2d76/users/af77036082974186be1d8fa4c12c3dd3/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:52:07.724095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c605d0-b1aa-4b30-b626-42676eaf4d2b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.724453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c605d0-b1aa-4b30-b626-42676eaf4d2b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.724559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c605d0-b1aa-4b30-b626-42676eaf4d2b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.725934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 549/1080] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:07.731644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:07.732186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:07.732318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:07.751325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:07.752559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:07.830077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 532/1081] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:07.853291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c605d0-b1aa-4b30-b626-42676eaf4d2b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:07.969466 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c605d0-b1aa-4b30-b626-42676eaf4d2b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:08.010226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:08.010812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:08.011092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:08.011370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:08.015595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:08.097762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:08.099233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:08.200829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 550/1082] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:08.206884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:08.308993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf434af3-fe37-40c9-8baf-6283c1159364 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:08.339024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:08.348517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:08.349320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:08.349598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:08.349848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:08.360561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:08.362030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3c834fd9-8b15-46cc-939f-4d8ab8e94e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:08.380360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:08.381311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:08.382211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:08.382211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:08.382211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:08.382211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:08.382211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 533/1083] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:08.389039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:08.427932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:08.497714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8a9a7-3bd6-48da-a78f-afb233a164b8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:08.533562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:08.534210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:08.534490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:08.534754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:08.535465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:08.535762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:08.537155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b26c9-655b-4dbe-9cef-457b884ba885 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:08.552347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 551/1084] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:09.463441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2124a5-150a-4560-ba48-0277fe47fd7f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.463969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2124a5-150a-4560-ba48-0277fe47fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.463969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2124a5-150a-4560-ba48-0277fe47fd7f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.465734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 534/1085] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:09.471628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0cd04-38b8-41a4-abe2-342573d3e502 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.472098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0cd04-38b8-41a4-abe2-342573d3e502 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.472190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0cd04-38b8-41a4-abe2-342573d3e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.489645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a7d0cd04-38b8-41a4-abe2-342573d3e502 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:09.490838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a7d0cd04-38b8-41a4-abe2-342573d3e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:09.562144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 552/1086] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:09.585860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2124a5-150a-4560-ba48-0277fe47fd7f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:09.695264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2124a5-150a-4560-ba48-0277fe47fd7f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:09.723719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982cc5-822e-4e1a-bafb-e63d48334b87 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.723905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982cc5-822e-4e1a-bafb-e63d48334b87 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.724355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb982cc5-822e-4e1a-bafb-e63d48334b87 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.725769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 553/1087] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:09.730847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.731137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.731412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.732003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:09.732847 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.733119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.733392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.744438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:09.748928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:09.750214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:09.753179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:09.754177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:09.755025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 535/1088] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Jun 6 20:52:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:09.760917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:09.777616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:09.805637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:09.828259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 554/1089] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:52:09.852364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:09.867446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dd04a-f19d-436b-90de-207fb5f895fd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:09.902980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:09.903657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.903934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.904254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:09.905010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:09.905314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:09.907297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:09.915801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 536/1090] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:52:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:09.921769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:09.951479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d5b58-d084-4433-a504-0e8679d5c490 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:09.987845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:09.988630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:09.988919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:09.989196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.000635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:10.008304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:10.009420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:10.010465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 555/1091] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:10.015937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.028984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fbfee-17aa-437e-9b1d-cc6787a8b957 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.030326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.038155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.067110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.067927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.068240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.068517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.080043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.081522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:10.099558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:10.100600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:10.101506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:10.101506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:10.101506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:10.101506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:10.101506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 537/1092] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:10.106672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.124343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431cc3-02a3-40fe-a92c-705a87af2bd4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.159716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.160438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.160720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.160995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.161746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:10.162053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.163459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.173241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 556/1093] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:10.178923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.213184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2577b5-0f5c-48a8-8231-1a34204114e3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.249345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.250158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.250429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.250695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.251517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:10.251813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.253255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.260116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.266393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 538/1094] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:10.272131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.282832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9a0e-0548-450c-a41f-35f81f177df3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.288242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.317629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.318507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.318784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.319054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] PATH_INFO: `/v3/users/af77036082974186be1d8fa4c12c3dd3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.320275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] RBAC: Authorizing `identity:get_user(user_id=af77036082974186be1d8fa4c12c3dd3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.321721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.328381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 557/1095] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/users/af77036082974186be1d8fa4c12c3dd3 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:10.329406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.381821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244852-9808-4438-b0a6-e71c7c2f4683 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.418563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.419379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.419656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.419926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.427507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.429024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.438185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901bfa-0f02-4716-b7b1-95057691f918 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:52:10.445384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:10.446630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:10.447642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 539/1096] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:52:10.452532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.476794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.478086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.478375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.478636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.494863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.531964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.554138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.555608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.562623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2d09-ea0c-4e5f-a24f-41ede8756a39 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.601453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.602146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.602407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.602696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.603546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:10.603846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.605385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.626265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 540/1097] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:10.631883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.671304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 558/1098] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 20:52:10.673009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.724940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.741351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3ba3-931d-4a04-988f-0d823f88d20e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.772012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.777897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.778557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.778839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.779115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.780355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb47b4-a8f7-4ed8-8d86-bac029b5699f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.820647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.821552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.821833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.822108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.823337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.824838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.826594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 559/1099] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:10.833328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.849602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.851077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.938171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964245-023f-49a0-b768-0cd6aec4a85e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:10.952907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:10.955156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 541/1100] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 20:52:10.961344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:10.976412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:10.977077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:10.977364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:10.977646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:10.978477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=e404eb39a9a640028dba8963461f2d76, user.id=af77036082974186be1d8fa4c12c3dd3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:10.978786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:10.980255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:10.986387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 560/1101] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/role_assignments?user.id=af77036082974186be1d8fa4c12c3dd3&scope.project.id=e404eb39a9a640028dba8963461f2d76&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:10.993878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:11.071488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603887-60bc-41fe-94ce-c7b70bfac84b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:11.108896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:11.109926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:11.110204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:11.110481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:11.122302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:11.123800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:11.143554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:11.144660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:11.145587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:52:11.145587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:11.145587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:52:11.145587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:11.145587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 542/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:11.151008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:11.260884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47cb5-3821-496e-a1f1-242eb9ac9a28 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:11.295689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:11.296669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:11.297078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:11.297355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:11.298089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:11.298395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:11.299774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:11.316907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 561/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:11.318126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:11.409789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:11.426112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc08ac-76e5-4b5a-8eeb-3727c18d1822 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:11.461828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:11.462631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:11.462912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:11.463181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:11.470807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:11.472352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:52:11.486416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:11.487408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:11.488374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 543/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:11.493670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:11.535888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:11.597890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21f471-64df-4194-b397-eb23db63e9f5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:11.633288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:11.633955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:11.634230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:11.634503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:11.635283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:11.635586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:11.637047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6bbed-e474-4379-9b33-0b88ad70c17f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:11.649090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 562/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:11.655729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:11.760263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fd3c-5ced-4222-892e-fd51b81da8d5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:11.797188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:11.797841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:11.798120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:11.798390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:11.799218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] RBAC: Adding query filter params (role.id=c7a7af7c994f4152a13a6683b90973d5, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=4746a0f4669742ba9e03404e04ae0536) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:11.799525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:11.800989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beb1d3-5fc9-43a2-8e22-e0c5f77d784e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:11.807423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 544/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:11 2022] GET /identity/v3/role_assignments?user.id=4746a0f4669742ba9e03404e04ae0536&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=c7a7af7c994f4152a13a6683b90973d5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:13.340858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607873c4-b373-4247-85f6-b2277ad5e372 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:13.341388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607873c4-b373-4247-85f6-b2277ad5e372 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:13.341388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607873c4-b373-4247-85f6-b2277ad5e372 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:13.342700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 563/1107] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:13.349143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:13.349638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:13.349638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:13.366811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:13.368030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:13.370087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:13.437567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 545/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:13.462801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607873c4-b373-4247-85f6-b2277ad5e372 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:13.564902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:13.570377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607873c4-b373-4247-85f6-b2277ad5e372 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:13.608416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:13.609724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:13.609724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:13.610167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:13.611118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:13.612671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132b4eb-004a-4d0a-a054-a24ee79477bb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:13.614286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 564/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:13.620820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:13.725205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240e9bb-2d2a-4719-88c0-2e17e48e6725 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:13.760803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:13.761493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:13.761761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:13.762031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:13.762744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:13.764216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eef174-5e21-468d-84fa-ff69e5081153 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:13.774511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:13.801452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 546/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:52:13 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:16.109770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a169-c4d4-43e4-833b-7d006bd9703e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:16.110373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a169-c4d4-43e4-833b-7d006bd9703e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:16.110373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a169-c4d4-43e4-833b-7d006bd9703e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:16.111680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 565/1111] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:16.117385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:16.117830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:16.117934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:16.135783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:16.137021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:16.209265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 547/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:16.234493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511a169-c4d4-43e4-833b-7d006bd9703e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:16.342983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511a169-c4d4-43e4-833b-7d006bd9703e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:16.381519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:16.382383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:16.382662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:16.382937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] PATH_INFO: `/v3/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:16.384543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] RBAC: Authorizing `identity:get_role(role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:16.386392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:16.387779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 566/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:16 2022] GET /identity/v3/roles/3fac18083f284da8a654bbbc3a62d49b => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:16.394801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:16.501635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2af74-a457-4893-bd49-cee44d9b69de None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:16.526025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:16.537858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:16.538736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:16.539011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:16.539280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] PATH_INFO: `/v3/users/f66491f15d324ac78d6b764a757df4b7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:16.554425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] RBAC: Authorizing `identity:get_user(user_id=f66491f15d324ac78d6b764a757df4b7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:16.555905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:16.557685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 548/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:16 2022] GET /identity/v3/users/f66491f15d324ac78d6b764a757df4b7 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:16.564196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:16.604985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:16.672870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b887e-dc03-4b69-a15b-577198349ff6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:16.709149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:16.709831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:16.710113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:16.710386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:16.786333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:16.787775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:16.821859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:16.891843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 567/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:16.898073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:17.000954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a94ee-73e6-4166-bdae-e3cadca6088e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:17.039564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:17.040667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:17.041043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:17.041407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:17.042798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:17.044695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab45d3-3a28-485d-bd8a-68fb9fb08879 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:17.046629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 549/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:16 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:17.053973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:17.158686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bd50d-b94c-48c2-9a16-a3cd256f09bc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:17.193912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:17.194568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:17.194844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:17.195114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:17.195936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=e404eb39a9a640028dba8963461f2d76, user.id=f66491f15d324ac78d6b764a757df4b7) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:17.196268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:17.197699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00e368-c00d-4b16-9dca-7cb231251887 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:17.199728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:17.204123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 568/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:17 2022] GET /identity/v3/role_assignments?user.id=f66491f15d324ac78d6b764a757df4b7&scope.project.id=e404eb39a9a640028dba8963461f2d76&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:19.425269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310f63-5def-43e2-8a72-b0a44a28370e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:19.425799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310f63-5def-43e2-8a72-b0a44a28370e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:19.425799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310f63-5def-43e2-8a72-b0a44a28370e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:19.427106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 550/1118] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:19.432815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:19.433259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:19.433368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:19.451391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:19.452823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:19.524871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 569/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:19.549097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe310f63-5def-43e2-8a72-b0a44a28370e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:19.603762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:19.659961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe310f63-5def-43e2-8a72-b0a44a28370e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:19.693794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:19.694576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:19.694852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:19.695125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] PATH_INFO: `/v3/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:19.696652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] RBAC: Authorizing `identity:get_role(role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:19.698021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:19.699429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 551/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:19 2022] GET /identity/v3/roles/3fac18083f284da8a654bbbc3a62d49b => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:19.705958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:19.810526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b0841-ed45-4850-a2b4-d97be199e97f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:19.838824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:19.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:19.848749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:19.849038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:19.849305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] PATH_INFO: `/v3/users/f66491f15d324ac78d6b764a757df4b7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:19.850496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] RBAC: Authorizing `identity:get_user(user_id=f66491f15d324ac78d6b764a757df4b7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:19.851930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:19.853626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 570/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:19 2022] GET /identity/v3/users/f66491f15d324ac78d6b764a757df4b7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:19.860382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:19.979245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70b25-d8b9-4ec9-a794-6fe2d443e5d4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:19.998940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:20.019925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:20.020943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:20.021213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:20.021489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:20.022803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:20.024299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cff4c-1bfb-4275-8a65-8beb3283ad19 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:20.026041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 552/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:19 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:20.032708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:20.136839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d759-25dd-4e9b-9732-07e1002f6e65 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:20.172113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:20.172999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:20.173272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:20.173536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76/users/f66491f15d324ac78d6b764a757df4b7/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:20.175774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] RBAC: Authorizing `identity:create_grant(project_id=e404eb39a9a640028dba8963461f2d76, user_id=f66491f15d324ac78d6b764a757df4b7, role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:20.177237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25637f2e-434e-4735-abe2-0da39a28a292 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:20.193770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 571/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:52:20 2022] PUT /identity/v3/projects/e404eb39a9a640028dba8963461f2d76/users/f66491f15d324ac78d6b764a757df4b7/roles/3fac18083f284da8a654bbbc3a62d49b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:52:22.457517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038907-0d40-4e33-9558-e7a70cba5c6e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:22.458051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038907-0d40-4e33-9558-e7a70cba5c6e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:22.458051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038907-0d40-4e33-9558-e7a70cba5c6e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:22.459340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 553/1124] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:22.465200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:22.465968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:22.466096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:22.483769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:22.484981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:22.536329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:22.554714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 572/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:22.578462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038907-0d40-4e33-9558-e7a70cba5c6e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:22.688296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038907-0d40-4e33-9558-e7a70cba5c6e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:22.723762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:22.724557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:22.724833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:22.725103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] PATH_INFO: `/v3/roles/3fac18083f284da8a654bbbc3a62d49b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:22.726583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] RBAC: Authorizing `identity:get_role(role_id=3fac18083f284da8a654bbbc3a62d49b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:22.727968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:22.729389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 554/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:22 2022] GET /identity/v3/roles/3fac18083f284da8a654bbbc3a62d49b => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:22.735633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:22.845187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95512c8-30c9-4623-b47d-28d32f242f98 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:22.881993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:22.882906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:22.883187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:22.883457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] PATH_INFO: `/v3/users/f66491f15d324ac78d6b764a757df4b7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:22.884667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] RBAC: Authorizing `identity:get_user(user_id=f66491f15d324ac78d6b764a757df4b7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:22.886112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:22.887761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 573/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:22 2022] GET /identity/v3/users/f66491f15d324ac78d6b764a757df4b7 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:22.893890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:22.951499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:22.999890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666c1bf-a3d6-4d6b-80a4-0cda6f742d3f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:23.036336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:23.036983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:23.037236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:23.037525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:23.107421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:23.108949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:23.165131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:23.225010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 555/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:23.231374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:23.290058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:23.336235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb15c8-6b71-4a4f-9565-c0347ea3371b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:23.373029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:23.373904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:23.374164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:23.374466 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] PATH_INFO: `/v3/projects/e404eb39a9a640028dba8963461f2d76` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:23.376057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] RBAC: Authorizing `identity:get_project(project_id=e404eb39a9a640028dba8963461f2d76)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:23.377515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b400b4-2cd7-4e66-81d0-df638f64f464 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:23.379319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 574/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:23 2022] GET /identity/v3/projects/e404eb39a9a640028dba8963461f2d76 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:23.386272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:23.491367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328dab-548a-40c2-abc6-098aa80bb978 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:23.526967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:23.527620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:23.527911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:23.528213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:23.529019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] RBAC: Adding query filter params (role.id=3fac18083f284da8a654bbbc3a62d49b, scope.project.id=e404eb39a9a640028dba8963461f2d76, user.id=f66491f15d324ac78d6b764a757df4b7) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:23.529351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:23.531035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e58c-b584-4e71-acb3-1302743cb587 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:23.537230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 556/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:23 2022] GET /identity/v3/role_assignments?user.id=f66491f15d324ac78d6b764a757df4b7&scope.project.id=e404eb39a9a640028dba8963461f2d76&role.id=3fac18083f284da8a654bbbc3a62d49b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:25.935024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d337-3329-44db-a139-92b3ef764c72 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:25.935597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d337-3329-44db-a139-92b3ef764c72 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:25.935597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d337-3329-44db-a139-92b3ef764c72 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:25.937017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 575/1131] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:25.942593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc486-674f-40fc-801e-85683eb4115a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:25.943050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc486-674f-40fc-801e-85683eb4115a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:25.943155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc486-674f-40fc-801e-85683eb4115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:25.960732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-413dc486-674f-40fc-801e-85683eb4115a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:25.961935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-413dc486-674f-40fc-801e-85683eb4115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:25.976560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:26.036886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 557/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:26.060484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d337-3329-44db-a139-92b3ef764c72 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:26.166762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d337-3329-44db-a139-92b3ef764c72 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:26.191354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:26.203850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:26.204688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:26.204973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:26.205253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:26.206453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:26.207898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b652dc1-892a-4e1e-bee9-a5794c8a7db5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:26.209606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 576/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:26.216082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc486-674f-40fc-801e-85683eb4115a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:26.321090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc486-674f-40fc-801e-85683eb4115a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:26.363119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:26.363785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:26.364092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:26.364361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:26.365054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:26.366496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d20518-2a87-417e-b454-e56a9fb7aeeb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:26.392207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:26.399445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 558/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:52:26 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:28.776760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7536-897b-4ca2-8bba-63cacd9f0934 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:28.777364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7536-897b-4ca2-8bba-63cacd9f0934 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:28.777364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde7536-897b-4ca2-8bba-63cacd9f0934 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:28.778669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 577/1135] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:28.784928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:28.785382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:28.785491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:28.803471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:28.804672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:28.877795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 559/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:28.904416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde7536-897b-4ca2-8bba-63cacd9f0934 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:29.014024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde7536-897b-4ca2-8bba-63cacd9f0934 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:29.051133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:29.051946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:29.052253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:29.052520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:29.053749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:29.055193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c422-07c4-48ef-bca5-0cd08a23ad56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:29.056850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 578/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:29.062996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:29.171066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600540d0-3b9c-4807-b22f-6c31af168acd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:29.203512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:29.210216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:29.210898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:29.211172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:29.211448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:29.212202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:29.213671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d891-c7d7-4266-b8f0-430e297df51b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:29.237917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 560/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:52:29 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:31.552541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417b21a-1748-4983-8f5c-e4266d2ff0b1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:31.553150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417b21a-1748-4983-8f5c-e4266d2ff0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:31.553150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417b21a-1748-4983-8f5c-e4266d2ff0b1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:31.554471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 579/1139] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:31.560250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:31.560725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:31.560822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:31.579060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:31.580315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:31.653599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 561/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:31.677779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417b21a-1748-4983-8f5c-e4266d2ff0b1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:31.744631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:31.790715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417b21a-1748-4983-8f5c-e4266d2ff0b1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:31.826416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:31.827171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:31.827550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:31.827942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:31.838533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:31.846672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:31.847844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:31.848787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 580/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:31.854154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:31.966478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdee5d-1d37-4040-9b45-2ea2c782b81c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:31.984217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:32.004927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:32.005627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:32.005905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:32.006176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:32.006909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:32.007221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:32.008644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:32.017565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 562/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:32.023529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:32.134826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff9eb-3573-4cb6-8363-ed834fcb3c5d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:32.154173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:32.175443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:32.176371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:32.176647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:32.176916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] PATH_INFO: `/v3/users/e3d0f22826904b319b4b07f1106c7066` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:32.193992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] RBAC: Authorizing `identity:get_user(user_id=e3d0f22826904b319b4b07f1106c7066)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:32.195480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:32.197280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 581/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:32 2022] GET /identity/v3/users/e3d0f22826904b319b4b07f1106c7066 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:32.203760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:32.319364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbcb6-87bc-49b0-a36b-3210f372a151 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:32.359284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:32.359933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:32.360237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:32.360509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:32.407843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:32.430585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:32.432094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:32.532991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 563/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:32.539248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:32.649506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec37d89-425f-4ba5-bdcc-66df60464a50 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:32.686283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:32.687558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:32.687867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:32.688171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] PATH_INFO: `/v3/projects/c019f8ee05654e36981e9a695482ced6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:32.689431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] RBAC: Authorizing `identity:get_project(project_id=c019f8ee05654e36981e9a695482ced6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:32.690879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e71f8-70ca-43d8-aa0d-f2b9bf48f574 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:32.692640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 582/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:32 2022] GET /identity/v3/projects/c019f8ee05654e36981e9a695482ced6 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:32.698982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:32.778180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:32.800561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02869c6-584f-4411-bc81-580f54dc9dbd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:32.834959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:32.835614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:32.835893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:32.836192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:32.837044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c019f8ee05654e36981e9a695482ced6, user.id=e3d0f22826904b319b4b07f1106c7066) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:32.837357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:32.838788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8cfde-cfc5-4b21-b6d5-2c40daac3f23 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:32.845023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 564/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:32 2022] GET /identity/v3/role_assignments?user.id=e3d0f22826904b319b4b07f1106c7066&scope.project.id=c019f8ee05654e36981e9a695482ced6&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:35.067455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b7fe-4bea-4972-8158-43c99c196c24 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.068051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b7fe-4bea-4972-8158-43c99c196c24 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.068051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b7fe-4bea-4972-8158-43c99c196c24 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.069510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 583/1147] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:35.075174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.075603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.075708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.094894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:35.096152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:35.171788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 565/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:35.194905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b7fe-4bea-4972-8158-43c99c196c24 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:35.244367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:35.302706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b7fe-4bea-4972-8158-43c99c196c24 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:35.337028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:35.337833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.338116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.338463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.350200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:35.357793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:35.358912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:35.359780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 584/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:35.365398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:35.442687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:35.481397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aecc1-219c-4547-9488-a8f681766252 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:35.518576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:35.519253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.519533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.519802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.520595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:35.520904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:35.522291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:35.531641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 566/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:35.539008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:35.646592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85237-1c6a-493c-9cbe-16d5bc35d25d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:35.648923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:35.688700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:35.689607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.689886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.690159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] PATH_INFO: `/v3/users/e3d0f22826904b319b4b07f1106c7066` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.691480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] RBAC: Authorizing `identity:get_user(user_id=e3d0f22826904b319b4b07f1106c7066)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:35.692986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:35.694760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 585/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:35 2022] GET /identity/v3/users/e3d0f22826904b319b4b07f1106c7066 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:35.700850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:35.811338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32f77b-721f-424e-ae5b-5a892d7edb87 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:35.850805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:35.851685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:35.851963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:35.852266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] PATH_INFO: `/v3/projects/c019f8ee05654e36981e9a695482ced6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:35.853458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] RBAC: Authorizing `identity:get_project(project_id=c019f8ee05654e36981e9a695482ced6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:35.854897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13448-8ee9-46a1-8d9b-cb4de1b30e4c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:35.856685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 567/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:35 2022] GET /identity/v3/projects/c019f8ee05654e36981e9a695482ced6 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:35.865164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:35.974845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7b92-0665-440f-868f-c51be1a3830b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:36.009690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:36.010592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:36.010868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:36.011157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] PATH_INFO: `/v3/projects/c019f8ee05654e36981e9a695482ced6/users/e3d0f22826904b319b4b07f1106c7066/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:36.013236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] RBAC: Authorizing `identity:create_grant(project_id=c019f8ee05654e36981e9a695482ced6, user_id=e3d0f22826904b319b4b07f1106c7066, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:36.014724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746333a-9602-469d-bf69-6e5611933195 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:36.029787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 586/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:52:35 2022] PUT /identity/v3/projects/c019f8ee05654e36981e9a695482ced6/users/e3d0f22826904b319b4b07f1106c7066/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:52:38.234010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfebb-1792-45d4-9c6e-92db9a30f289 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:38.234688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfebb-1792-45d4-9c6e-92db9a30f289 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:38.234688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfebb-1792-45d4-9c6e-92db9a30f289 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:38.236300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 568/1154] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:38.241792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:38.242216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:38.242383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:38.260938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:38.262146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:38.289248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.334077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 587/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:38.361400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfebb-1792-45d4-9c6e-92db9a30f289 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:38.364975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.474174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfebb-1792-45d4-9c6e-92db9a30f289 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:38.507522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:38.508353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:38.508638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:38.508920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:38.520704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:38.528352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:38.529510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:38.531100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 569/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:38.536502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:38.644617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1f15f-8c70-4a35-a96e-38fcf3f815ec None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:38.681250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:38.681900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:38.682203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:38.682474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:38.683215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:38.683517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:38.684918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:38.694152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 588/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:38.700369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:38.772015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.816684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e34ac-6cfc-4261-9059-0ba6b6962bef None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:38.853029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:38.853904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:38.854177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:38.854443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] PATH_INFO: `/v3/users/e3d0f22826904b319b4b07f1106c7066` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:38.855658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] RBAC: Authorizing `identity:get_user(user_id=e3d0f22826904b319b4b07f1106c7066)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:38.857128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:38.858979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 570/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:38 2022] GET /identity/v3/users/e3d0f22826904b319b4b07f1106c7066 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:38.867963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:38.898119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:38.983782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7655-58c7-4dc4-96f5-6fed1f44bc57 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:39.021011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:39.021688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:39.021970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:39.022241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:39.099144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:39.100677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:39.125388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:39.202312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 589/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:39.208735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:39.312194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aa04-13c0-4746-85b9-386b475b4a23 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:39.341887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:39.348363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:39.349226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:39.349514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:39.349786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] PATH_INFO: `/v3/projects/c019f8ee05654e36981e9a695482ced6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:39.350997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] RBAC: Authorizing `identity:get_project(project_id=c019f8ee05654e36981e9a695482ced6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:39.352479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96634302-7757-4e9f-a8c7-13944e5c7384 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:39.354218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 571/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:39 2022] GET /identity/v3/projects/c019f8ee05654e36981e9a695482ced6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:39.361505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:39.464387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d237b-c354-4653-b1c2-8bb018d3e0cf None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:39.488712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:39.500320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:39.500982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:39.501263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:39.501523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:39.502352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c019f8ee05654e36981e9a695482ced6, user.id=e3d0f22826904b319b4b07f1106c7066) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:39.502665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:39.504154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f0b2c-5f7f-4c7f-8841-f0a2c8e7a5d0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:39.510140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 590/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:39 2022] GET /identity/v3/role_assignments?user.id=e3d0f22826904b319b4b07f1106c7066&scope.project.id=c019f8ee05654e36981e9a695482ced6&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:41.763284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b9c-08ea-4017-a3e4-8e42b5abbb5b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:41.763876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b9c-08ea-4017-a3e4-8e42b5abbb5b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:41.763876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b9c-08ea-4017-a3e4-8e42b5abbb5b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:41.765463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 572/1162] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:41.771122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:41.771539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:41.771673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:41.790632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:41.791851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:41.865255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 591/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:41.888523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6b9c-08ea-4017-a3e4-8e42b5abbb5b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:41.998453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6b9c-08ea-4017-a3e4-8e42b5abbb5b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:42.037701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:42.038365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:42.038645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:42.038923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:42.109452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:42.113230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:42.115161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:42.223501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 573/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:42.230045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:42.337041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24aff8-8a3b-46df-8758-5e79cde302e1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:42.357280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:42.377261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:42.378088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:42.378363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:42.378628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:42.386500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:42.388011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-65d8c56f-466a-455d-bdb9-b049af61cb40 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:42.403910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:42.405640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:52:42.406512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 592/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:52:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:42.412243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:42.519601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:42.523687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a67df2-78db-4d5b-89ef-bdfd0ada5583 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:42.561508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:42.562174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:42.562450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:42.562719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:42.563448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:42.563750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:42.565154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fcfd9-9351-454a-a543-4223070383a3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:42.572975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 574/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Jun 6 20:52:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:44.839525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb226-617b-4acb-b86c-886ff201986a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:44.840107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb226-617b-4acb-b86c-886ff201986a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:44.840107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb226-617b-4acb-b86c-886ff201986a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:44.841828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 593/1167] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:44.847764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0ed6-a4ec-4b61-b978-fa617bdabdb5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:44.848215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0ed6-a4ec-4b61-b978-fa617bdabdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:44.848363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0ed6-a4ec-4b61-b978-fa617bdabdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:44.867019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e3fa0ed6-a4ec-4b61-b978-fa617bdabdb5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:44.868273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e3fa0ed6-a4ec-4b61-b978-fa617bdabdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:44.937293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 575/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:44.961121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb226-617b-4acb-b86c-886ff201986a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:45.069774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb226-617b-4acb-b86c-886ff201986a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:45.106221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:45.106789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:45.107049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:45.107321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:45.108246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:45.109685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c403-b8f8-4a22-bdf8-d0692a0e878d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:45.126569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 594/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Mon Jun 6 20:52:44 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 20:52:47.635367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586698-b939-46d2-996e-242f6d83dc13 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:47.635922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586698-b939-46d2-996e-242f6d83dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:47.636358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80586698-b939-46d2-996e-242f6d83dc13 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:47.638923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 576/1170] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:47.646418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:47.646953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:47.647078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:47.665738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:47.666957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:47.700686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:47.743900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 595/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:47.769125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80586698-b939-46d2-996e-242f6d83dc13 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:47.871414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:47.883436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80586698-b939-46d2-996e-242f6d83dc13 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:47.920983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:47.921642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:47.921922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:47.922192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] PATH_INFO: `/v3/domains/e9d8eb79bbd541cdb35e17a49c8033ad` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:47.933046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e9d8eb79bbd541cdb35e17a49c8033ad)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:47.934517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc48f-b738-46ea-b910-d761da66d775 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:47.936459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 577/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Jun 6 20:52:47 2022] GET /identity/v3/domains/e9d8eb79bbd541cdb35e17a49c8033ad => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:47.942569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:48.055049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8db31-2767-4297-a880-6b39943095a3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:48.101983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:48.102657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:48.102962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:48.103233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:48.104081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:48.105672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2157a07-0888-4329-985e-9e1db36f5bba None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:48.133534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 596/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:52:47 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:50.470592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0f87-7b1e-4338-bcac-375c434d56f6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:50.471457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0f87-7b1e-4338-bcac-375c434d56f6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:50.471787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0f87-7b1e-4338-bcac-375c434d56f6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:50.473625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 578/1174] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:50.478969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:50.479448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:50.479525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:50.496666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:50.497857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:50.513096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:50.571424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 597/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:50.596985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0f87-7b1e-4338-bcac-375c434d56f6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:50.707286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0f87-7b1e-4338-bcac-375c434d56f6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:50.743716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:50.744536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:50.744813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:50.745082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] PATH_INFO: `/v3/domains/e9d8eb79bbd541cdb35e17a49c8033ad` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:50.746347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e9d8eb79bbd541cdb35e17a49c8033ad)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:50.747799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469253f2-1185-4610-a55a-2fedff5f6bb6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:50.749804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 579/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Jun 6 20:52:50 2022] GET /identity/v3/domains/e9d8eb79bbd541cdb35e17a49c8033ad => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:50.756030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:50.859818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187f9c-166a-4faf-a08b-296d85d7d9df None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:50.895400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:50.896077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:50.896371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:50.896640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:50.897353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:50.898794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ad376-e6a5-43fd-aeaa-47876cfb6cb4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:50.921419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 598/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:52:50 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:52:53.299876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8922-296c-4e5c-9f84-7b1d2a8168d1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:53.300450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8922-296c-4e5c-9f84-7b1d2a8168d1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:53.300450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8922-296c-4e5c-9f84-7b1d2a8168d1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:53.301747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 580/1178] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:53.308026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:53.308581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:53.308581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:53.322144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:53.328633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:53.330781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:53.415487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 599/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:53.439579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8922-296c-4e5c-9f84-7b1d2a8168d1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:53.468015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:53.552825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8922-296c-4e5c-9f84-7b1d2a8168d1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:53.588910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:53.589702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:53.589980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:53.590597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:53.601698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:53.609677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:53.610882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:53.611897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:53.616186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 581/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:53.617351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:53.730849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8c41-aa1c-4e4d-9518-4bb6ccd6eaf2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:53.774865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:53.775565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:53.775855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:53.776155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:53.776924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:53.777235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:53.778635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:53.782340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:53.789559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 600/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:52:53.795867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:53.885848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:53.908463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004993-4b4d-489f-bca6-050f7c3d9622 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:53.947974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:53.948900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:53.949182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:53.949454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] PATH_INFO: `/v3/users/8abdd366d20748f1b54851095736fea7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:53.963560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] RBAC: Authorizing `identity:get_user(user_id=8abdd366d20748f1b54851095736fea7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:53.965120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:53.967513 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 582/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:53 2022] GET /identity/v3/users/8abdd366d20748f1b54851095736fea7 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:53.973977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:54.093423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1689-b013-4c1e-af99-65530cf82e87 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:54.128930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:54.129580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:54.129869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:54.130147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:54.195366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:54.199929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:54.201462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:54.307494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 601/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:52:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:52:54.314548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:54.421462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1bba8-efbd-4a45-80cd-673376f98e81 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:54.456438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:54.457208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:54.457482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:54.457749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] PATH_INFO: `/v3/projects/71547908253d4efaaffed8346fa67c32` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:54.458947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] RBAC: Authorizing `identity:get_project(project_id=71547908253d4efaaffed8346fa67c32)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:54.460408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d46ea-c23f-45e9-a31e-1c23c4d3007f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:54.462116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 583/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:54 2022] GET /identity/v3/projects/71547908253d4efaaffed8346fa67c32 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:54.469284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:54.567888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:54.572140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422270c0-96df-4bb2-8f2a-3b742d7806b1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:54.609029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:54.609708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:54.609987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:54.610256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:54.611092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=71547908253d4efaaffed8346fa67c32, user.id=8abdd366d20748f1b54851095736fea7) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:54.611401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:54.612924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b7c0-6a66-48ce-b365-a920e08c78be None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:54.619451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 602/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:52:54 2022] GET /identity/v3/role_assignments?user.id=8abdd366d20748f1b54851095736fea7&scope.project.id=71547908253d4efaaffed8346fa67c32&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:56.975294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861e65-1f1c-4b47-ae89-11f25e3e9e86 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:56.975892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861e65-1f1c-4b47-ae89-11f25e3e9e86 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:56.975985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861e65-1f1c-4b47-ae89-11f25e3e9e86 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:56.977362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 584/1186] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:52:56.986241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:56.986968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:56.986968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.004626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:52:57.005838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:52:57.075686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 603/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:52:57.099159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41861e65-1f1c-4b47-ae89-11f25e3e9e86 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:57.109366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:57.213178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41861e65-1f1c-4b47-ae89-11f25e3e9e86 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:57.252744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:57.253451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:57.253727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:57.253995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.265807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:52:57.273652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:52:57.274856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:52:57.275807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 585/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:52:57.281797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:57.385038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:57.395210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e79d-8643-4a9d-b397-3f21a147471b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:57.432523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:57.433204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:57.433485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:57.433755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.434508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:52:57.434812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:57.436289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:57.445773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 604/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:57.452897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:57.532494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:57.569812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a40a-d23b-4fef-980b-a49555a45e4f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:57.606089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:57.606968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:57.607250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:57.607529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] PATH_INFO: `/v3/users/8abdd366d20748f1b54851095736fea7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.610105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] RBAC: Authorizing `identity:get_user(user_id=8abdd366d20748f1b54851095736fea7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:57.611579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:57.613316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 586/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:52:57 2022] GET /identity/v3/users/8abdd366d20748f1b54851095736fea7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:57.620551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:57.722529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6069b3-bd89-4efb-92b1-cc60e62fbd9d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:57.756654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:57.757523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:57.757802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:57.758078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] PATH_INFO: `/v3/projects/71547908253d4efaaffed8346fa67c32` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.759290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] RBAC: Authorizing `identity:get_project(project_id=71547908253d4efaaffed8346fa67c32)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:57.760756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e32c-d8d3-4cbe-a18e-78d17db1b8cb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:57.762476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 605/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:52:57 2022] GET /identity/v3/projects/71547908253d4efaaffed8346fa67c32 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:52:57.769301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:52:57.875653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8425-6357-4123-a615-0d46dbaff59b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:52:57.910564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:52:57.911457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:52:57.911732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:52:57.912034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] PATH_INFO: `/v3/projects/71547908253d4efaaffed8346fa67c32/users/8abdd366d20748f1b54851095736fea7/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:52:57.914099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] RBAC: Authorizing `identity:create_grant(project_id=71547908253d4efaaffed8346fa67c32, user_id=8abdd366d20748f1b54851095736fea7, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:52:57.915548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c432f4-93d9-4cef-bf28-ba8ad881246f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:52:57.917784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:52:57.931612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 587/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:52:57 2022] PUT /identity/v3/projects/71547908253d4efaaffed8346fa67c32/users/8abdd366d20748f1b54851095736fea7/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:53:00.171438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01597cdf-34ae-4c83-9a87-c80c89ac8fb4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.172117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01597cdf-34ae-4c83-9a87-c80c89ac8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.172117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01597cdf-34ae-4c83-9a87-c80c89ac8fb4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:00.173396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 606/1193] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:53:00.178900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.179381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.179482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:00.196806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:53:00.198006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:53:00.269731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 588/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:53:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:53:00.293601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01597cdf-34ae-4c83-9a87-c80c89ac8fb4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:00.320939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:00.408765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01597cdf-34ae-4c83-9a87-c80c89ac8fb4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:00.447087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:00.447896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.448231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.448473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:00.459560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:53:00.467435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:53:00.468619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:53:00.469553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 607/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:53:00.474870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:00.578383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aa6a0-0934-4333-b0ce-2e2f2da2ff26 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:00.602557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:00.615727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:00.616471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.616751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.617008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:00.617756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:53:00.618061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:53:00.619438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:53:00.628470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 589/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:53:00.634669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:00.728268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:00.748985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b43e-5acf-40b2-aab8-d7a5fde94b47 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:00.786741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:00.787636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.787913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.788227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] PATH_INFO: `/v3/users/8abdd366d20748f1b54851095736fea7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:00.789613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] RBAC: Authorizing `identity:get_user(user_id=8abdd366d20748f1b54851095736fea7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:53:00.791097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:53:00.792863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 608/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Jun 6 20:53:00 2022] GET /identity/v3/users/8abdd366d20748f1b54851095736fea7 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:53:00.799289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:00.912406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33d18c-4ae6-4646-8e66-27eb7e0bf3d8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:00.950699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:00.951492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:00.951909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:00.952294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:01.016059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:01.031413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:53:01.032964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:53:01.135845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 590/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:53:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:53:01.142607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:01.248062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709e76-470a-4f6d-87db-fa1306757170 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:01.283241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:01.284139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:01.284417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:01.284684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] PATH_INFO: `/v3/projects/71547908253d4efaaffed8346fa67c32` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:01.285898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=71547908253d4efaaffed8346fa67c32)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:53:01.287329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aabc8-d671-4c20-a3c0-b3b73a75d2c5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:53:01.289061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 609/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Jun 6 20:53:01 2022] GET /identity/v3/projects/71547908253d4efaaffed8346fa67c32 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:53:01.295571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:53:01.383125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:01.398794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e5963-1743-4c3c-8151-1f290575afc4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:53:01.432497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:53:01.433147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:53:01.433417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:53:01.433688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:53:01.434508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=71547908253d4efaaffed8346fa67c32, user.id=8abdd366d20748f1b54851095736fea7) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:53:01.434818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:53:01.436591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cc272-9e14-4ab5-92a3-69b013af88fa None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:53:01.442775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 591/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:53:01 2022] GET /identity/v3/role_assignments?user.id=8abdd366d20748f1b54851095736fea7&scope.project.id=71547908253d4efaaffed8346fa67c32&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:53:11.278327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:53:11.440030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=25 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:05.468134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8797-664d-4b4f-8ec6-2426a8e6ed53 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:05.468134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8797-664d-4b4f-8ec6-2426a8e6ed53 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:05.468134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8797-664d-4b4f-8ec6-2426a8e6ed53 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:05.469482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 610/1201] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:05.476454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:05.477604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:05.478167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:05.499765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:05.501256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:05.600565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 592/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:05.631635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8797-664d-4b4f-8ec6-2426a8e6ed53 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:05.813090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8797-664d-4b4f-8ec6-2426a8e6ed53 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:05.883777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:05.883777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:05.883777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:05.883777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:05.904925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:05.906523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:05.928809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:05.930323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:05.932251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:05.932251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:05.932251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:05.932251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:05.936875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 611/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:05.937773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:06.142638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d9cf5-f043-4328-a5b7-f27026ab3e6b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:06.193294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:06.201261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:06.202082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:06.202385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:06.202788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:06.203680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:06.204009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:06.205709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caebfd1-774d-4a34-ae0a-01ffdbc7c0a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:06.224045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 593/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:06.233614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:06.317426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:06.383524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddf20-905a-4f1e-b148-8eba9f5e593d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:06.443227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:06.444309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:06.444748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:06.445081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:06.445877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:06.450536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ece0d2-aff3-47c6-9e11-c14d67691bb1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:06.482048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 612/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Jun 6 20:54:06 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:54:09.349166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e789-37ef-42a1-94b8-8ffd7dbbf865 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:09.349722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e789-37ef-42a1-94b8-8ffd7dbbf865 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:09.349834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e789-37ef-42a1-94b8-8ffd7dbbf865 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:09.351695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 594/1206] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:09.358474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:09.358981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:09.359169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:09.380625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:09.382015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:09.471688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 613/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:09.497422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528e789-37ef-42a1-94b8-8ffd7dbbf865 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:09.624807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528e789-37ef-42a1-94b8-8ffd7dbbf865 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:09.661480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:09.662363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:09.662738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:09.663072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:09.675138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:09.682814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:09.685048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:09.685990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 595/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:54:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:09.690393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:09.740390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:09.812385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1c0f-7ef9-41d4-9c18-6adee0356fba None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:09.855474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:09.856489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:09.856940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:09.857310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:09.858113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:09.858427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:09.859882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:09.869581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 614/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:54:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:09.879491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:09.941494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:10.028103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbfbb4-818f-46c6-9ed1-bf5ee1a3489a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:10.083724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:10.084591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:10.084877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:10.085146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:10.097953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:10.100145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:10.121138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:10.123035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:10.124241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:10.124241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:10.124241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:10.124241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:10.124241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 596/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:10.129139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:10.253027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:10.256907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd218-b3b8-4b33-84ec-d3edb173cff5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:10.305200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:10.305964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:10.306329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:10.306668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:10.307600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:10.308004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:10.309850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:10.325441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 615/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:10.334030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:10.453061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1bbe-0196-4a52-92c0-ae17c4ef382a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:10.454741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:10.499386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:10.500254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:10.500544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:10.500952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:10.512632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:10.516483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:10.532876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:10.534241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:10.535268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:10.539982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 597/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:10.541372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:10.676677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d810-8a3c-4d4f-b079-1b6ab9deffb0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:10.718706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:10.720191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:10.720191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:10.720191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:10.720749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:10.721190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:10.722724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:10.743313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 616/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:10.750079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:10.898327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce53f-50e7-42a0-bb31-b1c4bfc5e80d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:10.941770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:10.942431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:10.943112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:10.943112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:10.990816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:11.052485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:11.053994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:11.179195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 598/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:54:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:54:11.185259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:11.206385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:11.305896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac180-d631-4881-a39a-a5d5cb05421c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:11.345473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:11.346280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:11.346611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:11.346908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:11.359164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:11.360806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:11.381825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:11.383100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:11.384262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:11.384262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:11.384262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:11.384262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:11.384262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 617/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:11.390923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:11.457970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:11.503557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf1bb-bd8a-4836-9e52-48b207b5d82b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:11.545865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:11.546551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:11.546826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:11.547107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:11.547840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:11.548176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:11.549588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:11.564026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 599/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:11.570051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:11.651415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:11.687847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cecdc-06fe-4f00-ab94-1e19271b0aad None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:11.868203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:11.869014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:11.869293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:11.869564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:11.878663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:11.880205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:11.895322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:11.896376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:11.897270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:11.900445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 618/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:11.902722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:12.039301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130649ce-a938-4291-a04c-842f64d6f60e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:12.072725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:12.087214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:12.088242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:12.088666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:12.089111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:12.090593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:12.091096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:12.092813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29221-c1c3-4482-afe5-b50794f89ede None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:12.108836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 600/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:12.115011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:12.236617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc38e-0e4d-4b34-85f9-291e286e73ac None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:12.270795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:12.277347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:12.278261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:12.278546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:12.278871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:12.279896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=18b00832e92241ee803efdb173c94f0e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:12.280245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:12.281808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860999-28eb-4175-a87e-2bb821538437 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:12.294583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 619/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:54:12 2022] GET /identity/v3/role_assignments?user.id=18b00832e92241ee803efdb173c94f0e&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:14.595942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbccdcf-8a4a-4af5-95ff-d5aaedfdfc52 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:14.596543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbccdcf-8a4a-4af5-95ff-d5aaedfdfc52 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:14.596543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbccdcf-8a4a-4af5-95ff-d5aaedfdfc52 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:14.597893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 601/1220] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:14.603676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:14.604225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:14.604312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:14.623419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:14.624750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:14.706965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 620/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:14.734046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbccdcf-8a4a-4af5-95ff-d5aaedfdfc52 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:14.870939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbccdcf-8a4a-4af5-95ff-d5aaedfdfc52 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:14.909967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:14.910851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:14.911119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:14.911383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:14.926691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:14.936212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:14.937822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:14.938979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 602/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:54:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:14.943797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:15.082195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847707a-4244-482d-a553-4d3b2ef6d396 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:15.116121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:15.137540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:15.138655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:15.139123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:15.139557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:15.140879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:15.141370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:15.143956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:15.159556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 621/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:54:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:15.168975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:15.248683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:15.321721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59642f-e5dd-42e4-b22d-da19564d0085 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:15.364111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:15.365042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:15.365356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:15.365669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:15.379321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:15.380934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:15.399256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:15.400392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:15.401467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:15.401467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:15.401467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:15.401467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:15.401467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 603/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:15.408424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:15.525551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb577-aa2b-4214-82f1-0b1d8240fc56 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:15.564560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:15.565260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:15.565538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:15.565806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:15.566525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:15.566825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:15.568354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:15.580943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 622/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:15.586980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:15.694606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:15.702217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc29a90-24ff-4bdc-b14c-027c654a025d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:15.751466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:15.752839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:15.753075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:15.753421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:15.764276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:15.765999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:15.785177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:15.786241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:15.787212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 604/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:15.792878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:15.852333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:15.916725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b155-50b2-4328-8d94-60ebc95d4d0f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:15.956764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:15.957357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:15.957638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:15.957907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:15.958743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:15.959048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:15.960547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:15.979768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 623/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:15.986417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:16.119695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b936d51-3c7c-4c2d-a429-7f45fbc267eb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:16.159119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:16.160255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:16.160685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:16.161068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:16.173299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:16.174808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:16.195096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:16.196356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:16.197544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:16.197544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:16.197544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:16.197544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:16.197544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 605/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:16.203619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:16.322054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b8a50-bc1b-4c2e-a377-0ea5492aedab None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:16.324643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:16.359004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:16.359670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:16.359946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:16.360254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:16.360978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:16.361281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:16.362714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:16.384943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 624/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:16.391867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:16.409541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:16.531692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e56d0-0e85-4a1c-972c-9cd5fa2621e0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:16.569416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:16.570563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:16.570850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:16.571153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:16.578976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:16.580462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:16.596280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:16.597371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:16.598728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 606/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:16.603470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:16.723188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f66f4-03f0-4de5-8eb9-423beed52fd5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:16.768814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:16.769608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:16.769962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:16.770270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:16.771285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:16.771727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:16.773370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b824-fb3f-4a30-8a40-fa9a988affe6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:16.788558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 625/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:16.794849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:16.873389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:16.916942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dff3d8-8ae6-4536-9567-5864070427e1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:16.962822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:16.963717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:16.964012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:16.964319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/18b00832e92241ee803efdb173c94f0e/roles/3bc41493e8674a91b17d1f4eb91a1a64` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:16.980413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=18b00832e92241ee803efdb173c94f0e, role_id=3bc41493e8674a91b17d1f4eb91a1a64)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:16.982296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449ab3-1984-4e9f-a13d-e55043cf352f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:16.995075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 607/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:54:16 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/18b00832e92241ee803efdb173c94f0e/roles/3bc41493e8674a91b17d1f4eb91a1a64 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:54:19.394085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ccf1-a6b3-4fce-a792-32a7eeabfd8d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:19.394652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ccf1-a6b3-4fce-a792-32a7eeabfd8d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:19.394652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ccf1-a6b3-4fce-a792-32a7eeabfd8d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:19.395891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 626/1233] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:19.401902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:19.402550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:19.402550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:19.422019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:19.423511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:19.503217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 608/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:19.528144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ccf1-a6b3-4fce-a792-32a7eeabfd8d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:19.557666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:19.652199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ccf1-a6b3-4fce-a792-32a7eeabfd8d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:19.690607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:19.691448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:19.691686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:19.692015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:19.702868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:19.711531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:19.712775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 20:54:19.713851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:19.714660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 627/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Jun 6 20:54:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:19.721110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:19.777769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:19.850970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079e4a-a8bb-45ad-88af-b34030b72b84 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:19.893792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:19.894605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:19.894842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:19.895165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:19.895919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:19.896471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:19.897677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:19.907774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 609/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Jun 6 20:54:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:19.913624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:20.015605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:20.043572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff2db-3769-4d64-b4a4-c9f5841433ff None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:20.089623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:20.091119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:20.091410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:20.091704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:20.103484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:20.105041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:20.124880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:20.126052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:20.127222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:20.127222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:20.127222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:20.127222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:20.132117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:20.132314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 628/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:20.244600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6637ef-734d-4102-a461-5c31a61a84db None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:20.260818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:20.285261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:20.286116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:20.286431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:20.286736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:20.287629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:20.288099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:20.289541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:20.307719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 610/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:20.309133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:20.425073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9e832-2e51-4d4f-9e7c-eacbaf93c8f7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:20.465555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:20.466441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:20.466740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:20.467076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:20.470414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:20.476585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:20.478284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:20.494811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:20.495978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:20.497067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:20.497654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 629/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:20.502559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:20.626872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3641c-24eb-4943-9ad0-8f0e6dbca151 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:20.668244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:20.669031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:20.669310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:20.669706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:20.670505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:20.670817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:20.672253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:20.691383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 611/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:20.697372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:20.823894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489a40-e833-427a-9ecf-24b5bae34e5c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:20.872682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:20.873345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:20.873668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:20.873967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:20.939365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:20.946827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:20.948353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:21.067197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 630/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:54:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:54:21.073505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:21.104535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:21.195229 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212c3c-0d7b-4605-bcbb-e3d2106ae797 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:21.238756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:21.239664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:21.239962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:21.240293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:21.253269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:21.255573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:21.276234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:21.277300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:21.278491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:21.278491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:21.278491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:21.278491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:21.278491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 612/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:21.283914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:21.389004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:21.396049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b413ad-3fe3-4697-84a6-ab8cd8c00da4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:21.434460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:21.435172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:21.435403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:21.435683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:21.436508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:21.436808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:21.438225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:21.456184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 631/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:21.463173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:21.549201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:21.572797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfc669-def1-4908-adb0-9a3bbe809b68 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:21.610816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:21.611617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:21.611889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:21.612196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:21.619296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:21.620778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:21.635304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:21.636473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:21.638043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 613/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:21.643077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:21.757190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d448ae-1cfd-459b-8c1f-b639720bf903 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:21.801536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868813-2710-41da-969c-8d597de147ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:21.802436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868813-2710-41da-969c-8d597de147ba None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:21.802696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868813-2710-41da-969c-8d597de147ba None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:21.802984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868813-2710-41da-969c-8d597de147ba None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:21.803882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868813-2710-41da-969c-8d597de147ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:21.804316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868813-2710-41da-969c-8d597de147ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:21.805982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868813-2710-41da-969c-8d597de147ba None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:21.823038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 632/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:21.829658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:21.941757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc5f-6fb1-45a6-9068-69eb003eab94 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:21.979706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:21.980477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:21.980824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:21.981198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:21.982076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] RBAC: Adding query filter params (role.id=3bc41493e8674a91b17d1f4eb91a1a64, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=18b00832e92241ee803efdb173c94f0e) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:21.982588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:21.984125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5b48-c2b9-4528-91ff-caa9031deac6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:22.004363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 614/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:54:21 2022] GET /identity/v3/role_assignments?user.id=18b00832e92241ee803efdb173c94f0e&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=3bc41493e8674a91b17d1f4eb91a1a64 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:24.436284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f3f9-83f2-4287-a1e4-4933fb8d5a87 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:24.436809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f3f9-83f2-4287-a1e4-4933fb8d5a87 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:24.436809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f3f9-83f2-4287-a1e4-4933fb8d5a87 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:24.438130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 633/1247] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:24.444261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:24.444785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:24.444931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:24.452752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:24.467357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:24.468638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:24.546041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 615/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:24.569839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f3f9-83f2-4287-a1e4-4933fb8d5a87 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:24.590723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:24.691600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f3f9-83f2-4287-a1e4-4933fb8d5a87 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:24.732198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:24.733097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:24.733483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:24.733853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:24.748285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:24.760307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:24.761332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:24.762673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 634/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:24.768405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:24.881365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e90c-59ff-46dc-81ad-55f9b1d58886 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:24.913612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:24.919472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:24.920194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:24.920487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:24.920763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:24.921614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:24.921926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:24.923402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:24.938072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 616/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:24.939380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:25.028140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:25.060099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6a9a4-370d-407e-8a79-a8441a208136 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:25.101143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:25.102192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:25.102547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:25.102907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:25.116444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:25.117922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:25.138970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:25.139970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:25.141184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:25.141184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:25.141184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:25.141184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:25.141184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 635/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:25.146683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:25.271121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c9ca7-9285-465f-a4fa-350257275c69 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:25.310356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:25.311081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:25.311395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:25.311684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:25.312456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:25.312759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:25.314154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:25.327857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 617/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:25.333698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:25.446413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816c28-8ab0-485a-80c5-416dd4a560ee None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:25.478933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:25.495662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:25.497213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:25.497507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:25.498073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:25.507856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:25.509521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:25.526543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:25.527675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:25.528790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 636/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:25.534471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:25.598224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:25.662924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5844f-f71d-4219-8e44-92173ee6484d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:25.715982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:25.716788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:25.717073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:25.717360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:25.718410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:25.718838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:25.720739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:25.743974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 618/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:25.750426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:25.882281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbe00-7484-4c1d-87d2-61357be43cc3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:25.924758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:25.925518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:25.925945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:25.926224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:25.998506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:26.011939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:26.013459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:26.143445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 637/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:54:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:54:26.149236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:26.268860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169552e-1e1b-4dd0-84c9-92b3bbab18fb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:26.285910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:26.310951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:26.311855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:26.312161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:26.312439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:26.323606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:26.325587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:26.349412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:26.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:26.351685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:26.351685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:26.351685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:26.351685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:26.351685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 619/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:26.357196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:26.469936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:26.488171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd082-8f9c-4df1-8a60-59c3172311ac None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:26.527659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:26.528547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:26.528822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:26.529095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:26.529827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:26.530132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:26.531530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:26.544362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 638/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:26.551466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:26.694690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42798-9aa4-44f1-bedb-7ab0e1865642 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:26.734421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:26.735109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:26.735381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:26.735679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:26.743315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:26.744839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:26.761088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:26.762417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:26.763328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 620/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:26.770321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:26.885293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1293a37-db76-4272-a810-8b78a808a9c4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:26.921399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:26.922129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:26.922411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:26.922744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:26.923619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:26.923923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:26.925479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77657c-1e1e-45d7-819a-78679e987db5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:26.939192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 639/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:26.946065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:26.976995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:27.059937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c215-0fee-4383-844a-7c367b104921 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:27.097633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:27.098316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:27.098609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:27.098868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:27.099710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=18b00832e92241ee803efdb173c94f0e) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:27.100088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:27.101734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619283cd-d347-414e-9004-4b026d166c15 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:27.108841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 621/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:54:26 2022] GET /identity/v3/role_assignments?user.id=18b00832e92241ee803efdb173c94f0e&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 20:54:29.407270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6002-b060-49fb-a4ec-c876fc1ebfbf None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:29.407832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6002-b060-49fb-a4ec-c876fc1ebfbf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:29.407832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6002-b060-49fb-a4ec-c876fc1ebfbf None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:29.409268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 640/1261] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:29.415439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:29.415968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:29.415968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:29.436647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:29.437851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:29.514636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 622/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:29.541370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6002-b060-49fb-a4ec-c876fc1ebfbf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:29.553382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:29.651316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6002-b060-49fb-a4ec-c876fc1ebfbf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:29.688919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:29.689623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:29.689904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:29.690170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:29.701995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:29.709463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:29.711109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:29.712974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 641/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:29.718014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:29.738115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:29.836760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa7505-729e-4f74-ba2f-6a5fd55c721f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:29.881907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:29.882578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:29.882857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:29.883125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:29.883885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:29.884177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:29.885595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:29.894768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 623/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:29.901185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:29.976513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:30.011712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebbee0-ac78-4756-b402-90ad3a604770 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.049117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.049926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.050197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.050470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.064994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.066464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:30.084449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:30.085548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:30.086513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:30.086513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:30.086513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:30.086513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:30.086513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 642/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:30.092454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:30.184210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:30.206248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708b93-9474-4d7c-a16d-5f261ddeff3f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.244100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.244678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.244954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.245225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.245988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:30.246329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.247776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.260359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 624/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:30.270269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:30.374384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf52dc-8e2b-41c2-a31f-8f90ed498d26 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.395687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:30.410754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.411575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.411855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.412162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.420579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.422077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:30.437736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:30.438986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:30.440402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 643/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:30.445088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:30.556087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d53da-cd23-4249-9103-99559ae037dd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.593260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.593932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.594206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.594475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.595312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:30.595611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.597077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.606156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:30.615459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 625/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:30.621781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:30.725395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b87a-60b7-4e34-a734-e5533586b127 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.764200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.765005 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.765284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.765596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.777710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.779174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:30.797053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:30.798206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:30.799305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:30.799305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:30.799305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:30.799305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:30.799305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 644/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:30.804879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:30.910121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33398d-f60e-40fc-906e-86aa0084a875 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:30.946479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:30.947147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:30.947430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:30.947703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:30.948467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:30.948777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:30.950302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:30.962819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 626/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:30.969697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:31.004914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:31.085837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973fef1-1c0b-4e02-8a8c-debcc78e3ba5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:31.124169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:31.125010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:31.125285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:31.125521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:31.133352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:31.134864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:31.151860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:31.158703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:31.159771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 645/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:31.161177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:31.228680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:31.274704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de04a-a4c7-4f7c-a9d0-c31eb6097001 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:31.310356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:31.311017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:31.311265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:31.311561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:31.312376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:31.312679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:31.314116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712051b-c179-4e2d-b2af-62c5caaf1b55 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:31.326613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 627/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:31.332894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:31.429532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:31.439599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04cc5-c44f-4eee-b074-9403bc618238 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:31.476406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:31.477299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:31.477576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:31.477846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] PATH_INFO: `/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/18b00832e92241ee803efdb173c94f0e/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:31.479856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c12f66034e6944f58cd1e70ce1ce0296, user_id=18b00832e92241ee803efdb173c94f0e, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:31.481521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb14c4-7874-4e41-a1a1-e8600d615aa5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:31.495848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 646/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Jun 6 20:54:31 2022] PUT /identity/v3/projects/c12f66034e6944f58cd1e70ce1ce0296/users/18b00832e92241ee803efdb173c94f0e/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 20:54:33.741116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6a87-1dc5-4229-8355-95feb6851531 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:33.741753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6a87-1dc5-4229-8355-95feb6851531 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:33.741753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6a87-1dc5-4229-8355-95feb6851531 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:33.743510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 628/1274] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:33.750263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:33.750869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:33.751015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:33.771663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:33.773082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:33.869290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 647/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:33.894920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6a87-1dc5-4229-8355-95feb6851531 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.006650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6a87-1dc5-4229-8355-95feb6851531 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.026410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:34.046079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.046897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.047177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.047443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.059624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 20:54:34.067575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:34.068920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:34.070436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 629/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Jun 6 20:54:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:34.076027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.187415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:34.208915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bfcf7-09e8-4e28-8343-4913d3a06078 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.248101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.248794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.249108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.249385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.250148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:34.250445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:34.251831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:34.261385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 648/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:34.267316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.382187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470f31-ff7c-4d7c-bd3f-39ac7cafddbd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.419571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.420408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.420702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.420976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.432102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:34.433589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:34.451005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:34.452112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:34.453056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:34.453056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:34.453056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:34.453056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:34.453056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 630/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:34.458810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.571721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a670a-d064-4ad6-a009-c8fd4c38af9d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.610493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.611164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.611450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.611729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.612493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:34.612802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:34.614190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:34.627094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 649/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:34.633108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.666849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:34.741129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9da4c5-96bf-4459-9c6c-c7b10a976134 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.777451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.778468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.778754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.779024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.787457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:34.788936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 20:54:34.803961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:34.805404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:34.806810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 631/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:34.813280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:34.817443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:34.925367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ffdb-2f46-4b21-81d1-a2f86bb272fe None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:34.964523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:34.965608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:34.965914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:34.966240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:34.967181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:34.967542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:34.969256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:34.991199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 650/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:34.997322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:35.101665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:35.112764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221536-ee50-4342-80f3-b4c1948f302c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:35.149738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:35.150343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:35.150622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:35.150893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:35.220975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:35.222153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:35.316232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:35.327296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 632/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Jun 6 20:54:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 20:54:35.334247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:35.399941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:35.439605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef2f6-a67b-45bf-aaab-4755863d0451 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:35.476214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:35.476917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:35.477198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:35.477462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:35.488281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:35.489748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 20:54:35.507903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:35.513993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:35.515124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 20:54:35.515124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 20:54:35.515124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 20:54:35.515124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:35.515124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 651/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 20:54:35.515447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:35.632392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fd73-912d-432c-81da-b6d983dc5616 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:35.667924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:35.668679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:35.668952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:35.669220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:35.669949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:35.670245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:35.671679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:35.683484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 633/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Jun 6 20:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:35.690280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:35.798582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e91e-303e-4d5b-b2f7-c11d693c1780 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:35.813502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:35.837073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:35.838240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:35.838637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:35.839093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:35.851591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:35.853532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 20:54:35.876786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:35.877987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jun 06 20:54:35.879205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 652/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Jun 6 20:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:35.886284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:35.954990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:36.023797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b720a-b6b9-4ab4-b535-38f90d9fb98b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:36.074817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:36.075771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:36.076482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:36.076956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:36.078256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:36.078731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:36.080830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04d33-c9ff-4eeb-a642-0ba46578dba2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:36.098299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 634/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Jun 6 20:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:36.105993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:36.217485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296a60-229f-4c08-b906-3cf0f9ad2e38 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:36.255946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:36.256750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:36.257037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:36.257313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:36.258145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] RBAC: Adding query filter params (role.id=752ec01362414518a74fb7fe863f812e, scope.project.id=c12f66034e6944f58cd1e70ce1ce0296, user.id=18b00832e92241ee803efdb173c94f0e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:36.258494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:36.260238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2134e-3ec8-4fd8-b6aa-75fb8e52b744 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:36.267880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 653/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Jun 6 20:54:36 2022] GET /identity/v3/role_assignments?user.id=18b00832e92241ee803efdb173c94f0e&scope.project.id=c12f66034e6944f58cd1e70ce1ce0296&role.id=752ec01362414518a74fb7fe863f812e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:38.659541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b978a2-4264-4e48-aa3f-968aafea06c4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:38.660158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b978a2-4264-4e48-aa3f-968aafea06c4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:38.660158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b978a2-4264-4e48-aa3f-968aafea06c4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:38.661535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 635/1288] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:38.667355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:38.669936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:38.670230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:38.692504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:38.693819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:38.728561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:38.782158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 654/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:38.806704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b978a2-4264-4e48-aa3f-968aafea06c4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:38.933831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b978a2-4264-4e48-aa3f-968aafea06c4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:38.946841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:38.973970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:38.974794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:38.975081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:38.975356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:38.976057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:38.977444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:38.991585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:38.993631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:38.995376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 636/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:54:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:39.000112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:39.142545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a3377-f78f-47c8-9131-b1cf64061971 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:39.179628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:39.180333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:39.180682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:39.180958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:39.181667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:39.181971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:39.183447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299c83-2d34-4272-996c-70365b37e0c2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:39.188934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 655/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 6 20:54:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:39.195718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:39.321756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc53-3463-4eb9-afe5-a7f8e77c1c04 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:39.378396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:39.379172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:39.379448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:39.379716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:39.380463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:39.380764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:39.382300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81f643-ddfb-4d1a-9201-5797e7c5c623 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:39.388476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 637/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 6 20:54:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:41.814350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b9cb-38a9-4b1b-b7c0-927ab60a72be None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:41.814942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b9cb-38a9-4b1b-b7c0-927ab60a72be None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:41.815476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817b9cb-38a9-4b1b-b7c0-927ab60a72be None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:41.818250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 656/1293] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:41.825410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7ed14-0e0e-4472-a197-1967b3dc8472 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:41.826016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7ed14-0e0e-4472-a197-1967b3dc8472 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:41.826016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7ed14-0e0e-4472-a197-1967b3dc8472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:41.853338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-faf7ed14-0e0e-4472-a197-1967b3dc8472 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:41.854623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-faf7ed14-0e0e-4472-a197-1967b3dc8472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:41.893808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:41.939045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 638/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 20:54:41.962321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817b9cb-38a9-4b1b-b7c0-927ab60a72be None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:41.999135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:42.085216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817b9cb-38a9-4b1b-b7c0-927ab60a72be None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:42.127757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:42.128594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:42.128878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:42.129185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:42.130045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:42.131632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f8e2d-3560-438e-8983-e95d3d119f20 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:42.148370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 657/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Jun 6 20:54:41 2022] POST /identity/v3/services => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:54:44.542145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593e36-794b-4921-8b51-1531bfcaefbc None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:44.542750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593e36-794b-4921-8b51-1531bfcaefbc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:44.542750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593e36-794b-4921-8b51-1531bfcaefbc None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:44.544353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 639/1296] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:44.549829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:44.550295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:44.550395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:44.572101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:44.573314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:44.649595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 658/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:44.673557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593e36-794b-4921-8b51-1531bfcaefbc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:44.790582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593e36-794b-4921-8b51-1531bfcaefbc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:44.832646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:44.833364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:44.833643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:44.833915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:44.834573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:44.835950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:44.848620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:44.849689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:44.850693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 640/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:54:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:44.856423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:44.876361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:44.961960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146398f-614b-408d-92f5-fb307ec517ef None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:44.999215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:44.999944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:45.000262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:45.000541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:45.001260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:45.001572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:45.002960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:45.008689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 659/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 6 20:54:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:45.017432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:45.051189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:45.124714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f4f9-d2b4-4329-b92e-ac0ec8da557c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:45.160238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:45.160897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:45.161176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:45.161447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:45.162238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] RBAC: Adding query filter params (interface=public, service_id=18a676474f6247fdb207d1e447e902d7, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:45.162544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:45.163921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620c1b1-e551-4d8c-a048-fe57101bb4a3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:45.169611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 641/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Jun 6 20:54:45 2022] GET /identity/v3/endpoints?service_id=18a676474f6247fdb207d1e447e902d7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:45.175553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:45.265097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:45.285101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29598a32-f155-43bc-b2e5-0f0bd9684886 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:45.321984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:45.322642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:45.322926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:45.323201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:45.324400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:45.325791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6dc5f-60d1-4e8c-bc66-8cdc7a9313e8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:45.332680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 660/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Jun 6 20:54:45 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 20:54:47.570089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52e1-1bc1-475e-b7c3-c9c3f504f9d5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:47.570746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52e1-1bc1-475e-b7c3-c9c3f504f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:47.570746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52e1-1bc1-475e-b7c3-c9c3f504f9d5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:47.572060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 642/1302] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:54:47.577739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:47.578190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:47.578295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:47.596484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:54:47.597688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:54:47.668212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 661/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:54:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 20:54:47.691292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec52e1-1bc1-475e-b7c3-c9c3f504f9d5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:47.800425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:47.810122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec52e1-1bc1-475e-b7c3-c9c3f504f9d5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:47.847049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:47.847774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:47.848084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:47.848340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:47.849005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:47.850396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 20:54:47.862782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 20:54:47.864027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 06 20:54:47.865158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 643/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Jun 6 20:54:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 20:54:47.870584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:47.957302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:47.986763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa51c48-6507-4b25-9641-c81745cd0cfc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:48.032720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:48.033523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:48.033886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:48.034169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:48.034953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 20:54:48.035333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:48.037071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5cace-2538-41ff-a40b-9852af4689d3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:48.044431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 662/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Jun 6 20:54:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 20:54:48.051701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:54:48.167172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f9173-0d9c-4527-8b1d-64e31247a4a1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:54:48.204674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:54:48.205351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:54:48.205628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:54:48.205900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:54:48.206654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:54:48.208047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825e2a1-e69d-4010-8368-9905f6989357 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:54:48.231219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 644/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Jun 6 20:54:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 20:54:58.039967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=30 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:54:58.226669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:55.827025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7cc60-ed07-40eb-bb9f-173509020657 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:55.827657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7cc60-ed07-40eb-bb9f-173509020657 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:55.827657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7cc60-ed07-40eb-bb9f-173509020657 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:55.833339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 663/1307] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:55:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:55:55.835049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4eda-0065-4bda-824e-7a1f3a64853a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:55.836322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4eda-0065-4bda-824e-7a1f3a64853a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:55.837241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4eda-0065-4bda-824e-7a1f3a64853a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:55.935002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-57fc4eda-0065-4bda-824e-7a1f3a64853a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:55:55.936289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-57fc4eda-0065-4bda-824e-7a1f3a64853a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:55:56.240636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 645/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:55:56.303130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:56.303610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:56.304105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:56.311568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 664/1309] 10.222.0.33 () {54 vars in 964 bytes} [Mon Jun 6 20:55:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:55:56.315119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c65f-56a9-4828-b377-d8997c928679 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:56.315509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c65f-56a9-4828-b377-d8997c928679 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:56.315881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c65f-56a9-4828-b377-d8997c928679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:56.461858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ea31c65f-56a9-4828-b377-d8997c928679 None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:55:56.463499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ea31c65f-56a9-4828-b377-d8997c928679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:55:56.491534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:56.581546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 646/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Jun 6 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:55:56.591772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:55:56.595243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:55:56.792711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58832e08-47eb-4f06-b471-ddef9846dfa8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:55:56.894654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:55:56.895282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:56.895559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:56.895975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:56.897923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:55:56.976496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:55:57.072649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:55:57.074837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5955-5aed-42ce-aa7f-958debec93dc service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:55:57.107082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 665/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:55:59.778943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:59.779464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:59.779464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:59.780827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 647/1312] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:55:59.786353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffb17-5dd2-4729-bc66-ee61306a6ed4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:55:59.786808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffb17-5dd2-4729-bc66-ee61306a6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:55:59.786922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffb17-5dd2-4729-bc66-ee61306a6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:55:59.875060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d5cffb17-5dd2-4729-bc66-ee61306a6ed4 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:55:59.876220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d5cffb17-5dd2-4729-bc66-ee61306a6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:00.007253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 666/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:00.047425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:00.048170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:00.187294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b863c5-8331-4474-9fc0-449651a55f84 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:00.293566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:00.296309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:00.297000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:00.297262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:00.297597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:00.299874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:00.435882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:00.437654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc4827-da6f-4d23-b1b4-26eac900c635 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:00.458398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 648/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:03.082154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:03.082786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:03.082786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:03.084328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 667/1315] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:03.091254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f4478-f200-485d-9d57-162d11537580 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:03.091803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f4478-f200-485d-9d57-162d11537580 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:03.091803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f4478-f200-485d-9d57-162d11537580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:03.165343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-405f4478-f200-485d-9d57-162d11537580 None None] MFA Rules not processed for user `add61fbfd50a4ffc9945b8b3c878bee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:03.166598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-405f4478-f200-485d-9d57-162d11537580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:03.227417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:03.277545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 649/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:03.320118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:03.322100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:03.334777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:03.447302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbf05b-5c1b-4115-b804-9d1caf55ce49 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:03.523728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:03.524433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:03.524717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:03.524988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:03.526720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:03.599187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:03.652388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:03.653886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8568b-3d43-4a6d-8e65-fb129ed6a2dd service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:03.674444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 668/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:06.581943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:06.582581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:06.582581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:06.583882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 650/1318] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:06.589706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe035b7-156f-41d4-ab51-01bbf22eca4b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:06.590172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe035b7-156f-41d4-ab51-01bbf22eca4b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:06.590280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe035b7-156f-41d4-ab51-01bbf22eca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:06.659742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-efe035b7-156f-41d4-ab51-01bbf22eca4b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:06.660993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-efe035b7-156f-41d4-ab51-01bbf22eca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:06.761536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 669/1319] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:06.801000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:06.802544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:06.913095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b51d2-70a7-4602-aa40-cf35d06fec13 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:06.993062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:06.993722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:06.994005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:06.994276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:06.995945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:07.003633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:07.116521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:07.118635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af21e86-8a31-4fc6-9e39-f78fdfff5e8a service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:07.137362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 651/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:10.129965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153c81-2396-48df-9b58-b3d4f8f4fd82 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:10.130551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153c81-2396-48df-9b58-b3d4f8f4fd82 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:10.130551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153c81-2396-48df-9b58-b3d4f8f4fd82 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:10.132210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 670/1321] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:10.140465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1bc2-8929-42f3-95f6-55b8f2db2c7c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:10.141130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1bc2-8929-42f3-95f6-55b8f2db2c7c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:10.141130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b1bc2-8929-42f3-95f6-55b8f2db2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:10.212829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-638b1bc2-8929-42f3-95f6-55b8f2db2c7c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:10.214054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-638b1bc2-8929-42f3-95f6-55b8f2db2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:10.274320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:10.318962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 652/1322] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:10.368023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:10.368429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:10.368769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:10.370227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 671/1323] 10.222.0.33 () {54 vars in 964 bytes} [Mon Jun 6 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:10.377095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c95e-7a5e-4607-826d-4d3153f4e8eb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:10.377392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c95e-7a5e-4607-826d-4d3153f4e8eb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:10.377739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c95e-7a5e-4607-826d-4d3153f4e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:10.464437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f242c95e-7a5e-4607-826d-4d3153f4e8eb None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:10.465669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f242c95e-7a5e-4607-826d-4d3153f4e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:10.548749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 653/1324] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Jun 6 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:10.562945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:10.564520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:10.586332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:10.688410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48751d-bb7d-4ec1-be64-4df34e72e5f8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:10.775042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:10.775711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:10.775981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:10.776299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:10.778007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:10.855802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:10.897799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:10.899438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe733a41-388e-4013-a5be-d2361eaa06aa service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:10.919402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 672/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:13.627365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:13.628055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:13.628179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:13.630495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 654/1326] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:13.639292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5348e-af3d-489b-b6cd-da75b433c30d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:13.639847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5348e-af3d-489b-b6cd-da75b433c30d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:13.640295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5348e-af3d-489b-b6cd-da75b433c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:13.715713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-50c5348e-af3d-489b-b6cd-da75b433c30d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:13.716996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-50c5348e-af3d-489b-b6cd-da75b433c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:13.823292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 673/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:13.859511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:13.861177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:13.929481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:13.975551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ce34-f50e-4625-9b7b-3c21085c996d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:14.063047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:14.063698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:14.063967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:14.064278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:14.065956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:14.200545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:14.203623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:14.205206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51346c5-96f2-4021-95db-8012d4e20d6c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:14.231815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 655/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:16.609470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:16.610059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:16.610059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:16.611757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 674/1329] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:16.620348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55cfe-a9a4-40ba-84a2-b70e600aedf2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:16.620888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55cfe-a9a4-40ba-84a2-b70e600aedf2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:16.621049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55cfe-a9a4-40ba-84a2-b70e600aedf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:16.700724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bec55cfe-a9a4-40ba-84a2-b70e600aedf2 None None] MFA Rules not processed for user `add61fbfd50a4ffc9945b8b3c878bee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:16.702189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bec55cfe-a9a4-40ba-84a2-b70e600aedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:16.812668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 656/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:16.852938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:16.854490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:16.887043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:16.972687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcdf26-d15a-4c6b-8e83-4fda086b1f55 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:17.062219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:17.062891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:17.063171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:17.063445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:17.065212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:17.160416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:17.196737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:17.198210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900997-d8a9-4645-8232-abf8b26a22bb service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:17.218950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 675/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:19.828422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:19.828879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:19.828879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:19.830286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 657/1332] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:19.837732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437ee5-2608-4d87-b2e6-fafb93c40e60 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:19.838584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437ee5-2608-4d87-b2e6-fafb93c40e60 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:19.838584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437ee5-2608-4d87-b2e6-fafb93c40e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:19.914467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8f437ee5-2608-4d87-b2e6-fafb93c40e60 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:19.915707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8f437ee5-2608-4d87-b2e6-fafb93c40e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:20.043503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 676/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:20.080682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:20.082195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:20.159004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:20.200007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861d819-d94f-40c2-8082-52664bd430b9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:20.298834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:20.299588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:20.299870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:20.300223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:20.302029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:20.452074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:20.453560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac74d54-0595-4d2f-bce9-abc70888daf2 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:20.468510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:20.481246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 658/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:22.883844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:22.884426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:22.884426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:22.885768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 677/1335] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:22.891967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0ad0-8af9-454c-92c4-b7679f0fa158 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:22.892648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0ad0-8af9-454c-92c4-b7679f0fa158 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:22.892648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0ad0-8af9-454c-92c4-b7679f0fa158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:22.978102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-766d0ad0-8af9-454c-92c4-b7679f0fa158 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:22.979397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-766d0ad0-8af9-454c-92c4-b7679f0fa158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:23.092711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 659/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:23.135126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:23.136770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:23.182022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:23.253177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ca4f-44c1-4e16-922f-bf113e6f065b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:23.334674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:23.335327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:23.335610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:23.335885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:23.337974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:23.427642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:23.458889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:23.460657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3ce2-ae00-4ea2-9356-f37390e37196 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:23.488307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 678/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 20:56:26.555806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:26.556423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:26.556423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:26.557718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 660/1338] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:26.563690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e7d1-7266-44b6-bf66-b2309a5ce21b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:26.564243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e7d1-7266-44b6-bf66-b2309a5ce21b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:26.564243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e7d1-7266-44b6-bf66-b2309a5ce21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:26.643697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-16e3e7d1-7266-44b6-bf66-b2309a5ce21b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:26.645166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-16e3e7d1-7266-44b6-bf66-b2309a5ce21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:26.769047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 679/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:56:26.806929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:26.809091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:26.899302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:26.936639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef9780-e397-4db4-b44e-6d09e2b59f30 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:26.941158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:26.941827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:26.942109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:26.942383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:26.983835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:26.986161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdffd-a259-46cc-a31c-84cdf49fac19 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:27.022388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 661/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 20:56:31.924583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951db9d-a2e3-42fc-8e6c-388ce9b1921c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:31.925065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951db9d-a2e3-42fc-8e6c-388ce9b1921c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:31.925183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951db9d-a2e3-42fc-8e6c-388ce9b1921c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:31.926541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 680/1341] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:31.933013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf3d3-f40b-45a0-97d7-4291c2b9c8ab None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:31.933533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf3d3-f40b-45a0-97d7-4291c2b9c8ab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:31.933629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf3d3-f40b-45a0-97d7-4291c2b9c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:31.999474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-496bf3d3-f40b-45a0-97d7-4291c2b9c8ab None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:32.000615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-496bf3d3-f40b-45a0-97d7-4291c2b9c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:32.082489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 662/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:32.122865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951db9d-a2e3-42fc-8e6c-388ce9b1921c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:32.135760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951db9d-a2e3-42fc-8e6c-388ce9b1921c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:32.139823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:32.140545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:32.140839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:32.141114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:32.152154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:32.153709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7c16a-c37e-4149-98c2-6e4fed81b4e7 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:32.167658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 681/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:35.176308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:35.176886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:35.176886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:35.178353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 663/1344] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:35.184085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f11b-b945-4be7-a4e1-9af399d08ccd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:35.184570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f11b-b945-4be7-a4e1-9af399d08ccd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:35.184679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f11b-b945-4be7-a4e1-9af399d08ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:35.214909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-13a1f11b-b945-4be7-a4e1-9af399d08ccd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:35.216162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-13a1f11b-b945-4be7-a4e1-9af399d08ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:35.224456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 682/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:35.262771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:35.264915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:35.279982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7f6e-01b9-4e3f-a46f-90967beed48a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:35.283939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:35.284635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:35.284919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:35.285199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:35.297871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:35.299341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb739b0-bb7d-4c85-93d6-e2439f1f3a7c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:35.310123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 664/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:40.109211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8e9-3496-4cf3-b62b-10c4a0d19e39 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:40.109765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8e9-3496-4cf3-b62b-10c4a0d19e39 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:40.110210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8e9-3496-4cf3-b62b-10c4a0d19e39 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:40.114143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 683/1347] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:40.121552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e995-3ff1-4593-b7d4-d5ccd33dbade None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:40.122398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e995-3ff1-4593-b7d4-d5ccd33dbade None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:40.122398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e995-3ff1-4593-b7d4-d5ccd33dbade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:40.145294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1468e995-3ff1-4593-b7d4-d5ccd33dbade None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:40.147138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1468e995-3ff1-4593-b7d4-d5ccd33dbade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:40.157209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 665/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:40.199607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f8e9-3496-4cf3-b62b-10c4a0d19e39 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:40.212962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f8e9-3496-4cf3-b62b-10c4a0d19e39 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:40.217194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:40.217869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:40.218153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:40.218401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:40.229879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:40.231401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca42fb-547f-41e6-a38b-3135ae105283 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:40.245115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 684/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:56:46.181599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edf8e-80f2-4da2-8183-9afe976296cd None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:46.182562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edf8e-80f2-4da2-8183-9afe976296cd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:46.183137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edf8e-80f2-4da2-8183-9afe976296cd None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:46.186201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 666/1350] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 20:56:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:56:46.190440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d135-9b6c-4253-83ab-243c7583d669 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:46.191169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d135-9b6c-4253-83ab-243c7583d669 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:46.191169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d135-9b6c-4253-83ab-243c7583d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:46.203567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:46.335483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3588d135-9b6c-4253-83ab-243c7583d669 None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:46.337762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3588d135-9b6c-4253-83ab-243c7583d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:46.581435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 685/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:56:50.138539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:51.716568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15df2c-6881-40f1-ad4c-5db66de67352 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:51.717256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15df2c-6881-40f1-ad4c-5db66de67352 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:51.717813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15df2c-6881-40f1-ad4c-5db66de67352 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:51.721019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 667/1352] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 20:56:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:51.728750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a5f-aac2-4f2b-9e22-139e7be77c6f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:51.729464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a5f-aac2-4f2b-9e22-139e7be77c6f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:51.729464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a5f-aac2-4f2b-9e22-139e7be77c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:51.755740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9c595a5f-aac2-4f2b-9e22-139e7be77c6f None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:51.757043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c595a5f-aac2-4f2b-9e22-139e7be77c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:51.768201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 686/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:53.348948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090097-fd55-417b-95bb-84238ff28a65 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:53.349825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090097-fd55-417b-95bb-84238ff28a65 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:53.349825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090097-fd55-417b-95bb-84238ff28a65 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:53.352742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 668/1354] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 20:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:53.359304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a046-48f2-4c91-9c62-4170de2457d9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:53.360113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a046-48f2-4c91-9c62-4170de2457d9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:53.360113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a046-48f2-4c91-9c62-4170de2457d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:53.381675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0a12a046-48f2-4c91-9c62-4170de2457d9 None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:53.382999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a12a046-48f2-4c91-9c62-4170de2457d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:53.393156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 687/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:56:57.560467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfa225-da72-43c9-87ed-67addaba27ea None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:57.561332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfa225-da72-43c9-87ed-67addaba27ea None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:57.561332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfa225-da72-43c9-87ed-67addaba27ea None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:57.564650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 669/1356] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:56:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:56:57.572233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918050-d5e3-4cd4-839f-aa23d65db884 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:57.572885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918050-d5e3-4cd4-839f-aa23d65db884 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:57.573380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f918050-d5e3-4cd4-839f-aa23d65db884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:57.598636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5f918050-d5e3-4cd4-839f-aa23d65db884 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:57.601066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5f918050-d5e3-4cd4-839f-aa23d65db884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:57.620049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 688/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:57.683073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326be9-9d11-4730-82bf-0e6245b0f47a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:57.683572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326be9-9d11-4730-82bf-0e6245b0f47a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:57.683745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326be9-9d11-4730-82bf-0e6245b0f47a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:57.686085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 670/1358] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 6 20:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:56:57.704826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c458e-7917-488f-b4a2-5d6523690166 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:57.706970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c458e-7917-488f-b4a2-5d6523690166 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:57.708709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c458e-7917-488f-b4a2-5d6523690166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:57.794413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ef3c458e-7917-488f-b4a2-5d6523690166 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:56:57.795984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef3c458e-7917-488f-b4a2-5d6523690166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:56:57.872131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:57.916905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 689/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 6 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:56:57.927164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326be9-9d11-4730-82bf-0e6245b0f47a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:56:57.946649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326be9-9d11-4730-82bf-0e6245b0f47a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:56:57.953800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:56:57.954672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:56:57.955014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:56:57.955580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:56:57.968629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:56:57.970745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba02f-b536-4e48-9b96-6c1d77e75217 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:56:57.988710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 671/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:01.064660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151fb6-bc40-484b-9457-52ce50d3a628 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:01.065369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151fb6-bc40-484b-9457-52ce50d3a628 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:01.065850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151fb6-bc40-484b-9457-52ce50d3a628 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:01.069130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 690/1361] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:01.078899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fd2df-e22b-43d3-a1be-b4b981a4330e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:01.079827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fd2df-e22b-43d3-a1be-b4b981a4330e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:01.079827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fd2df-e22b-43d3-a1be-b4b981a4330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:01.104795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ae6fd2df-e22b-43d3-a1be-b4b981a4330e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:01.106093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae6fd2df-e22b-43d3-a1be-b4b981a4330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:01.115622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 672/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:01.181029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61151fb6-bc40-484b-9457-52ce50d3a628 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:01.198395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61151fb6-bc40-484b-9457-52ce50d3a628 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:01.204868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:01.205635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:01.206001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:01.206361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:01.217635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:01.219582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685697f-0632-4960-b3cb-a96be68f1aab service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:01.232122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 691/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:03.915906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25830-7af8-4559-a2b1-6214a996f638 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:03.916502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25830-7af8-4559-a2b1-6214a996f638 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:03.916502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25830-7af8-4559-a2b1-6214a996f638 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:03.917824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 673/1364] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:03.923517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857221-95e4-4f53-b534-334e4e622f0a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:03.924075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857221-95e4-4f53-b534-334e4e622f0a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:03.924175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857221-95e4-4f53-b534-334e4e622f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:03.942989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-37857221-95e4-4f53-b534-334e4e622f0a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:03.944310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-37857221-95e4-4f53-b534-334e4e622f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:03.952621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 692/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:03.999753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42909-7eda-4225-9f12-9f075d6b3c3d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:04.000054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42909-7eda-4225-9f12-9f075d6b3c3d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:04.000360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42909-7eda-4225-9f12-9f075d6b3c3d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:04.001748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 674/1366] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 6 20:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:04.008251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f091fe8-7e9c-4304-b446-d93cd2c334e4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:04.008564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f091fe8-7e9c-4304-b446-d93cd2c334e4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:04.008844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f091fe8-7e9c-4304-b446-d93cd2c334e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:04.029468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9f091fe8-7e9c-4304-b446-d93cd2c334e4 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:04.030702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9f091fe8-7e9c-4304-b446-d93cd2c334e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:04.052836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 693/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 6 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:04.058192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42909-7eda-4225-9f12-9f075d6b3c3d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:04.074521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42909-7eda-4225-9f12-9f075d6b3c3d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:04.079974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:04.081234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:04.081520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:04.081808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:04.091860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:04.093933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942d02f-8769-48ab-90d4-329fb1370b4b service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:04.105402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 675/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:07.019575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2db05-7838-4944-bd65-e763e46c72cf None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.020290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2db05-7838-4944-bd65-e763e46c72cf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.020620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2db05-7838-4944-bd65-e763e46c72cf None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.023413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 694/1369] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:07.032425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b310-66fd-4742-8c3f-dac63d728344 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.032956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b310-66fd-4742-8c3f-dac63d728344 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.033379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b310-66fd-4742-8c3f-dac63d728344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.069813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ab34b310-66fd-4742-8c3f-dac63d728344 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:07.071035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab34b310-66fd-4742-8c3f-dac63d728344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:07.079338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 676/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:07.134319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2db05-7838-4944-bd65-e763e46c72cf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:07.162746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2db05-7838-4944-bd65-e763e46c72cf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:07.172571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:07.173692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.174173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.174663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.191657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:07.194234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e23a-2e39-4d39-9be9-96474a474c8f service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:07.209723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 695/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:07.253394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31cc39-af86-45ee-9f97-0ec5f8a63fa5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.253394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31cc39-af86-45ee-9f97-0ec5f8a63fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.253687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31cc39-af86-45ee-9f97-0ec5f8a63fa5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.255384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 677/1372] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:57:07.262921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb02ba-4c47-4c8a-930f-ea9162ff1cd7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.263208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb02ba-4c47-4c8a-930f-ea9162ff1cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.263482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb02ba-4c47-4c8a-930f-ea9162ff1cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.285832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a4bb02ba-4c47-4c8a-930f-ea9162ff1cd7 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:07.287643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4bb02ba-4c47-4c8a-930f-ea9162ff1cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:07.300326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 696/1373] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:07.593133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74943f-1bf5-4422-a64b-6ad7e52f2ee9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.593919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74943f-1bf5-4422-a64b-6ad7e52f2ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.594520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74943f-1bf5-4422-a64b-6ad7e52f2ee9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.596994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 678/1374] 10.222.0.33 () {54 vars in 963 bytes} [Mon Jun 6 20:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:07.603065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736bd4f-a54f-431f-9ff4-8887dc2b064c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.603520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736bd4f-a54f-431f-9ff4-8887dc2b064c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.603808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736bd4f-a54f-431f-9ff4-8887dc2b064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.709024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7736bd4f-a54f-431f-9ff4-8887dc2b064c None None] MFA Rules not processed for user `80cf9f259e6b448eafcf246c09f0ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:07.711595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7736bd4f-a54f-431f-9ff4-8887dc2b064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:07.830976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 697/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Mon Jun 6 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:57:07.848063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74943f-1bf5-4422-a64b-6ad7e52f2ee9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:07.870542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74943f-1bf5-4422-a64b-6ad7e52f2ee9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:07.876105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:07.877850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:07.878432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:07.878776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:07.894919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:07.897624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0fa01-f314-4f74-afdf-ab11bade7fc4 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:07.913334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 679/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:09.705848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba44b-dbe7-4608-83db-4c591ac4e42e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:09.706425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba44b-dbe7-4608-83db-4c591ac4e42e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:09.706425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba44b-dbe7-4608-83db-4c591ac4e42e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:09.707870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 698/1377] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:09.716771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a37b-498a-4963-a4c8-4c78f589bb83 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:09.717380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a37b-498a-4963-a4c8-4c78f589bb83 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:09.717824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a37b-498a-4963-a4c8-4c78f589bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:09.750417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f8d9a37b-498a-4963-a4c8-4c78f589bb83 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:09.752501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f8d9a37b-498a-4963-a4c8-4c78f589bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:09.769473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 680/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:09.818229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba44b-dbe7-4608-83db-4c591ac4e42e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:09.845296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba44b-dbe7-4608-83db-4c591ac4e42e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:09.854071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:09.854748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:09.855035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:09.855534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:09.868272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:09.869974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f20e5-61b0-4ef3-bef5-45818765641b service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:09.881514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 699/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:12.334442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84980-9de2-4f13-9f15-1efc873335f7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:12.335029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84980-9de2-4f13-9f15-1efc873335f7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:12.335505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84980-9de2-4f13-9f15-1efc873335f7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:12.337408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 681/1380] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:12.343116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734be-2aa3-4240-af9d-a23afa2d1f32 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:12.343769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734be-2aa3-4240-af9d-a23afa2d1f32 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:12.343769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734be-2aa3-4240-af9d-a23afa2d1f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:12.373923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f99734be-2aa3-4240-af9d-a23afa2d1f32 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:12.376129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f99734be-2aa3-4240-af9d-a23afa2d1f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:12.390655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 700/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:12.469524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84980-9de2-4f13-9f15-1efc873335f7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:12.485232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84980-9de2-4f13-9f15-1efc873335f7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:12.490902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:12.491651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:12.492026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:12.492376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:12.502010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:12.503606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb7f21-aa9f-4fdf-9863-6cd915eb5900 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:12.515185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 682/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:14.966795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067cb2-7bb9-48f9-837e-a549074b5fff None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:14.967352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067cb2-7bb9-48f9-837e-a549074b5fff None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:14.967352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067cb2-7bb9-48f9-837e-a549074b5fff None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:14.968601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 701/1383] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:57:14.974432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dec85-2f17-45e6-aa06-5ee794be8d57 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:14.974966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dec85-2f17-45e6-aa06-5ee794be8d57 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:14.974966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dec85-2f17-45e6-aa06-5ee794be8d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:14.994530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9a4dec85-2f17-45e6-aa06-5ee794be8d57 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:14.995785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9a4dec85-2f17-45e6-aa06-5ee794be8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:15.007027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 683/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:57:15.057855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067cb2-7bb9-48f9-837e-a549074b5fff None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:15.075315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067cb2-7bb9-48f9-837e-a549074b5fff None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:15.081747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:15.082582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:15.082942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:15.083189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:15.093747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:15.095918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a9ab4-3afc-4bc9-8549-ebd43fa399c1 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:15.107520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 702/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:17.727384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376acdf-fba8-4e31-9df1-f9a02007e204 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:17.728165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376acdf-fba8-4e31-9df1-f9a02007e204 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:17.728822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376acdf-fba8-4e31-9df1-f9a02007e204 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:17.732839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 684/1386] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:17.739371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172be-6e8c-411c-985b-709f66661636 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:17.740159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172be-6e8c-411c-985b-709f66661636 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:17.740159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172be-6e8c-411c-985b-709f66661636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:17.766356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-675172be-6e8c-411c-985b-709f66661636 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:17.768588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-675172be-6e8c-411c-985b-709f66661636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:17.782177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 703/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:17.838004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376acdf-fba8-4e31-9df1-f9a02007e204 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:17.853906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376acdf-fba8-4e31-9df1-f9a02007e204 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:17.863722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:17.864864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:17.865267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:17.865566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:17.877715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:17.880098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39743b2-a436-4a8f-b67d-01ed677e104e service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:17.893163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 685/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 20:57:20.477786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114252f4-622e-4001-ba06-840fc5dd1139 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:20.478376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114252f4-622e-4001-ba06-840fc5dd1139 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:20.478376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114252f4-622e-4001-ba06-840fc5dd1139 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:20.479754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 704/1389] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:20.486363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5819-ec94-41cb-a81d-9952bae60223 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:20.487146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5819-ec94-41cb-a81d-9952bae60223 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:20.487146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5819-ec94-41cb-a81d-9952bae60223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:20.500477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=43 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:20.518790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-739a5819-ec94-41cb-a81d-9952bae60223 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:20.521747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-739a5819-ec94-41cb-a81d-9952bae60223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:20.533782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 686/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:20.586518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114252f4-622e-4001-ba06-840fc5dd1139 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:20.605159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114252f4-622e-4001-ba06-840fc5dd1139 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:20.611038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:20.611713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:20.612031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:20.612313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:20.622163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:20.623829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca69b-9d6b-45da-9650-74abc08380cb service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:20.635503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 705/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:23.189467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fdc1-8298-42af-b33f-bd50b0c8de2a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:23.190088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fdc1-8298-42af-b33f-bd50b0c8de2a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:23.190088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fdc1-8298-42af-b33f-bd50b0c8de2a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:23.191427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 687/1392] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:23.197322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc337-f978-450f-b877-3eab98b37bea None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:23.197818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc337-f978-450f-b877-3eab98b37bea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:23.197923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc337-f978-450f-b877-3eab98b37bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:23.216220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-21cdc337-f978-450f-b877-3eab98b37bea None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:23.217422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-21cdc337-f978-450f-b877-3eab98b37bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:23.225822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 706/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:57:23.271416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fdc1-8298-42af-b33f-bd50b0c8de2a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:23.287158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fdc1-8298-42af-b33f-bd50b0c8de2a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:23.294279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:23.294981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:23.295245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:23.295514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:23.305935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:23.307466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee3190-c40b-4df1-9d7f-0c79baa41042 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:23.318121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 688/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:24.487886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f17-0faf-41dd-8af6-d030db7ed9d3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:24.488715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f17-0faf-41dd-8af6-d030db7ed9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:24.488715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf53f17-0faf-41dd-8af6-d030db7ed9d3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:24.490163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 707/1395] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:24.496131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389fb3-59eb-4f18-b3d2-0f1adb91adf1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:24.496792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389fb3-59eb-4f18-b3d2-0f1adb91adf1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:24.496792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389fb3-59eb-4f18-b3d2-0f1adb91adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:24.522411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-82389fb3-59eb-4f18-b3d2-0f1adb91adf1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:24.523611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-82389fb3-59eb-4f18-b3d2-0f1adb91adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:24.531803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 689/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:24.597921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-3ce6-4bfe-88f9-d3b3e866effb None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:24.598753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-3ce6-4bfe-88f9-d3b3e866effb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:24.599080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244d43-3ce6-4bfe-88f9-d3b3e866effb None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:24.604012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 708/1397] 10.222.0.33 () {54 vars in 962 bytes} [Mon Jun 6 20:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:24.610791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9048-a38b-42af-9c26-215682554ef8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:24.611000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9048-a38b-42af-9c26-215682554ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:24.611381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9048-a38b-42af-9c26-215682554ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:24.672316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c7af9048-a38b-42af-9c26-215682554ef8 None None] MFA Rules not processed for user `9cf17e40aeb64d3598124670b5981935`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:24.673557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c7af9048-a38b-42af-9c26-215682554ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:24.746019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 690/1398] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Jun 6 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:24.755847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244d43-3ce6-4bfe-88f9-d3b3e866effb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:24.767159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244d43-3ce6-4bfe-88f9-d3b3e866effb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:24.773018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:24.774254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:24.775516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:24.775516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:24.787297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:24.788886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ab3f-d43d-42af-ae09-d23880aa8785 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:24.793153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:24.801069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 709/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:25.376978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4516-978f-40d2-84d4-033927133882 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.377388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4516-978f-40d2-84d4-033927133882 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.377759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4516-978f-40d2-84d4-033927133882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.435096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fafb4516-978f-40d2-84d4-033927133882 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:25.436375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fafb4516-978f-40d2-84d4-033927133882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:25.522205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 691/1400] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:25.569993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91952c-be05-4b59-8119-162265b781f8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.570537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91952c-be05-4b59-8119-162265b781f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.570537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91952c-be05-4b59-8119-162265b781f8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.571934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 710/1401] 10.222.0.33 () {54 vars in 942 bytes} [Mon Jun 6 20:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:25.578648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.578936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.579346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.629278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:25.645933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] MFA Rules not processed for user `0e7356175da142a8a4a30b9476303b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:25.647179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:25.662068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b750f4-6b1b-48c0-9df3-ed6cd1461e80 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.662336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b750f4-6b1b-48c0-9df3-ed6cd1461e80 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.662819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b750f4-6b1b-48c0-9df3-ed6cd1461e80 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.664224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 711/1402] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:25.669974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.670339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.670680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.689349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:25.690611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:25.699860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 712/1403] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:57:25.727058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 692/1404] 10.222.0.33 () {58 vars in 1039 bytes} [Mon Jun 6 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:25.739877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:25.748184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:25.753149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74e7c3-f88e-4a7a-a725-8a10cbfcb647 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:25.760318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:25.761188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.761590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.761901 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.762006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bde45-d9de-4456-b1df-815159efef36 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:25.767561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:25.768247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:25.768547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:25.768804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:25.773791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:25.776086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bea9e-7cb2-4b35-a512-f99155f1cd70 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:25.779395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:25.781048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd269-0186-4a08-b34c-617b4f1b62a9 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:25.788651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 713/1405] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 20:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 20:57:25.791945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 693/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 20:57:28.216957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe15e-de8e-469b-8186-e3583413708a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:28.217738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe15e-de8e-469b-8186-e3583413708a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:28.217738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe15e-de8e-469b-8186-e3583413708a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:28.218859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 714/1407] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:28.224772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751359fa-4cae-4ea7-b8bf-f13975288479 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:28.225318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751359fa-4cae-4ea7-b8bf-f13975288479 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:28.225318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751359fa-4cae-4ea7-b8bf-f13975288479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:28.247632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-751359fa-4cae-4ea7-b8bf-f13975288479 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:28.248908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-751359fa-4cae-4ea7-b8bf-f13975288479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:28.257380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 694/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:28.311401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe15e-de8e-469b-8186-e3583413708a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:28.329341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe15e-de8e-469b-8186-e3583413708a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:28.335274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:28.336304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:28.336635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:28.336952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:28.349333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:28.350992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9b193-201a-4ca9-a79f-1e45f432f89a service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:28.366036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 715/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:38.237786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=42 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:38.359672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=16 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:49.005176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46612-71fd-4a7d-9d52-989ef4d920c8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:49.005790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46612-71fd-4a7d-9d52-989ef4d920c8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:49.005790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46612-71fd-4a7d-9d52-989ef4d920c8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:49.007310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 695/1410] 10.222.0.33 () {54 vars in 918 bytes} [Mon Jun 6 20:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:49.012974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42f1cb-fc9a-473e-a9a5-dd201c977e34 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:49.013477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42f1cb-fc9a-473e-a9a5-dd201c977e34 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:49.013477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42f1cb-fc9a-473e-a9a5-dd201c977e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:49.033359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1d42f1cb-fc9a-473e-a9a5-dd201c977e34 None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:49.034673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1d42f1cb-fc9a-473e-a9a5-dd201c977e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:49.044495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 716/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 6 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:49.059646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341c57-56a8-49fa-818c-0b6e79c1cab2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:49.059939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341c57-56a8-49fa-818c-0b6e79c1cab2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:49.060256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341c57-56a8-49fa-818c-0b6e79c1cab2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:49.061640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 696/1412] 10.222.0.33 () {54 vars in 918 bytes} [Mon Jun 6 20:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:49.066892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708359e-fd66-4cf3-b156-a13ae21a8ed1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:49.067173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708359e-fd66-4cf3-b156-a13ae21a8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:49.067449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708359e-fd66-4cf3-b156-a13ae21a8ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:49.086956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1708359e-fd66-4cf3-b156-a13ae21a8ed1 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:49.088066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1708359e-fd66-4cf3-b156-a13ae21a8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:49.099013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 717/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 6 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:51.864048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ac67-de75-4bef-9e1e-90dde5218c45 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:51.864690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ac67-de75-4bef-9e1e-90dde5218c45 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:51.864690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ac67-de75-4bef-9e1e-90dde5218c45 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:51.865957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:51.871688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc703e-8f4e-40d8-8d91-fd23008fdef3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:51.872234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc703e-8f4e-40d8-8d91-fd23008fdef3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:51.872344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc703e-8f4e-40d8-8d91-fd23008fdef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:51.891511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-54fc703e-8f4e-40d8-8d91-fd23008fdef3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:51.892755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-54fc703e-8f4e-40d8-8d91-fd23008fdef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:51.901969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:51.946740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ac67-de75-4bef-9e1e-90dde5218c45 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:51.962364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ac67-de75-4bef-9e1e-90dde5218c45 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:51.967982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:51.968658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:51.968940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:51.969215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:51.978393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:51.980097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0853e7-7b4e-4534-b7d0-695b70dd74c2 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:51.990513 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 698/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:52.998438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815d70-51b5-4cfc-b629-011129f35299 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:52.999056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815d70-51b5-4cfc-b629-011129f35299 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:52.999056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28815d70-51b5-4cfc-b629-011129f35299 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:53.000382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:53.006181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f4e8-837d-40cb-8597-feed8978b862 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:53.006680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f4e8-837d-40cb-8597-feed8978b862 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:53.006680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f4e8-837d-40cb-8597-feed8978b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:53.026313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e473f4e8-837d-40cb-8597-feed8978b862 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:53.027523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e473f4e8-837d-40cb-8597-feed8978b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:53.036881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:53.198927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28815d70-51b5-4cfc-b629-011129f35299 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:53.215333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28815d70-51b5-4cfc-b629-011129f35299 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:53.222804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:53.223544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:53.223856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:53.224151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:53.233325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:53.234920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c676d-bc3e-47fc-bf99-128ccc58009a service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:53.245597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 720/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:54.185076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394f4d-6b7b-40af-a17d-564d96eb95e9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:54.185654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394f4d-6b7b-40af-a17d-564d96eb95e9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:54.185654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394f4d-6b7b-40af-a17d-564d96eb95e9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:54.187022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:54.192663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaa8ac-0e69-44ca-b425-1962418dd6ef None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:54.193127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaa8ac-0e69-44ca-b425-1962418dd6ef None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:54.193245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaa8ac-0e69-44ca-b425-1962418dd6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:54.213922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-afdaa8ac-0e69-44ca-b425-1962418dd6ef None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:54.215195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-afdaa8ac-0e69-44ca-b425-1962418dd6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:54.225005 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:54.375295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df394f4d-6b7b-40af-a17d-564d96eb95e9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:54.392808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df394f4d-6b7b-40af-a17d-564d96eb95e9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:54.399529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:54.400248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:54.400536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:54.400808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:54.410878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:54.412554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3de8b-8d45-4b59-acac-29f307a2cb97 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:54.422510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 701/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:55.337315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cd26-3939-4544-9e82-75ddfb586db2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:55.337886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cd26-3939-4544-9e82-75ddfb586db2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:55.337886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cd26-3939-4544-9e82-75ddfb586db2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:55.339168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:55.344628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4277-3344-4232-a9f5-0a50ad666e21 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:55.345114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4277-3344-4232-a9f5-0a50ad666e21 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:55.345241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4277-3344-4232-a9f5-0a50ad666e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:55.365631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d66c4277-3344-4232-a9f5-0a50ad666e21 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:55.366859 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d66c4277-3344-4232-a9f5-0a50ad666e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:55.376565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:55.529320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4cd26-3939-4544-9e82-75ddfb586db2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:55.545847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4cd26-3939-4544-9e82-75ddfb586db2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:55.552503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:55.553169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:55.553449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:55.553720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:55.562974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:55.564618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8e697-236c-45b3-8260-63ff8ccfe7aa service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:55.576397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 723/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:56.489237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d54b-3e2f-4d4f-ba54-976dafa8de3f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:56.489851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d54b-3e2f-4d4f-ba54-976dafa8de3f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:56.489851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d54b-3e2f-4d4f-ba54-976dafa8de3f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:56.491200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:56.496644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b7fc-ddfd-4fb4-aa2c-87e4a018d2cb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:56.497062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b7fc-ddfd-4fb4-aa2c-87e4a018d2cb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:56.497203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b7fc-ddfd-4fb4-aa2c-87e4a018d2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:56.516185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c720b7fc-ddfd-4fb4-aa2c-87e4a018d2cb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:56.517412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c720b7fc-ddfd-4fb4-aa2c-87e4a018d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:56.525936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:56.674708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d54b-3e2f-4d4f-ba54-976dafa8de3f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:56.690585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d54b-3e2f-4d4f-ba54-976dafa8de3f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:56.696696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:56.697345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:56.697629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:56.697903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:56.707776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:56.709414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5bee1-f417-4a86-977c-33f1a99b60f9 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:56.719948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 704/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:57.581717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f7f1-81a5-4619-b4ba-34d3f47bb113 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:57.582294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f7f1-81a5-4619-b4ba-34d3f47bb113 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:57.582294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f7f1-81a5-4619-b4ba-34d3f47bb113 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:57.583786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:57.591559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ec11-028a-4c56-93a8-445125b17b72 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:57.592113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ec11-028a-4c56-93a8-445125b17b72 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:57.592113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ec11-028a-4c56-93a8-445125b17b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:57.611984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a355ec11-028a-4c56-93a8-445125b17b72 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:57.613232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a355ec11-028a-4c56-93a8-445125b17b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:57.622014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:57.769329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f7f1-81a5-4619-b4ba-34d3f47bb113 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:57.784609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f7f1-81a5-4619-b4ba-34d3f47bb113 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:57.790800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:57.791606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:57.791929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:57.792288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:57.801525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:57.803120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820216d-e196-47a4-9e99-83166c02aab9 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:57.813081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 726/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:58.659333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d20ed-db1e-4be3-a688-504a834f094d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:58.660079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d20ed-db1e-4be3-a688-504a834f094d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:58.660079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d20ed-db1e-4be3-a688-504a834f094d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:58.661275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:58.666448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c0a2-4933-436a-b9c8-e948648c85dd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:58.666897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c0a2-4933-436a-b9c8-e948648c85dd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:58.667020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c0a2-4933-436a-b9c8-e948648c85dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:58.686221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b7e3c0a2-4933-436a-b9c8-e948648c85dd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:58.687449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b7e3c0a2-4933-436a-b9c8-e948648c85dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:58.696694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:58.845924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d20ed-db1e-4be3-a688-504a834f094d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:58.861413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d20ed-db1e-4be3-a688-504a834f094d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:58.867699 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:58.868378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:58.868663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:58.868939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:58.877300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:58.879158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82735f50-9117-477e-ad5d-f03e4cbfe6d2 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:58.888942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 707/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:59.743852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51716-ae97-4ee5-9c46-d0988bd46141 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:59.744435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51716-ae97-4ee5-9c46-d0988bd46141 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:59.744435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac51716-ae97-4ee5-9c46-d0988bd46141 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:59.746729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:57:59.752983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf426fa-55dc-4488-86b0-20a4612f924a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:59.753485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf426fa-55dc-4488-86b0-20a4612f924a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:59.753600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf426fa-55dc-4488-86b0-20a4612f924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:59.773180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2bf426fa-55dc-4488-86b0-20a4612f924a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:57:59.774425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2bf426fa-55dc-4488-86b0-20a4612f924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:57:59.783419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:57:59.930148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51716-ae97-4ee5-9c46-d0988bd46141 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:57:59.947103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac51716-ae97-4ee5-9c46-d0988bd46141 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:57:59.953394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:57:59.954091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:57:59.954373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:57:59.954649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:57:59.965025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:57:59.966671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5576af-64f7-40df-b7d5-d718201d11b3 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:57:59.978266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 729/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:01.014492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a36f5-235e-42cd-bff3-ab8e8beddf12 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:01.015137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a36f5-235e-42cd-bff3-ab8e8beddf12 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:01.015137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a36f5-235e-42cd-bff3-ab8e8beddf12 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:01.017776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 20:58:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:01.023871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434585b6-dc10-44e5-a088-d8fbbf0fe630 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:01.024418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434585b6-dc10-44e5-a088-d8fbbf0fe630 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:01.024541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434585b6-dc10-44e5-a088-d8fbbf0fe630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:01.046316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-434585b6-dc10-44e5-a088-d8fbbf0fe630 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:01.047576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-434585b6-dc10-44e5-a088-d8fbbf0fe630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:01.058285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:58:01.225793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a36f5-235e-42cd-bff3-ab8e8beddf12 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:01.241365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a36f5-235e-42cd-bff3-ab8e8beddf12 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:01.247236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:01.247884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:01.248237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:01.248479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:01.257638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:01.259222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e81ac-eee0-49fc-b4aa-69c38f3e5954 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:01.269015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 710/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:03.408503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185e41-588e-407e-a495-47be391e0ed6 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:03.409113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185e41-588e-407e-a495-47be391e0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:03.409113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185e41-588e-407e-a495-47be391e0ed6 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:03.410657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:03.416292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bed8-d8a4-496d-be5b-91cf2d1682a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:03.416779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bed8-d8a4-496d-be5b-91cf2d1682a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:03.416928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3bed8-d8a4-496d-be5b-91cf2d1682a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:03.436499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-33e3bed8-d8a4-496d-be5b-91cf2d1682a3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:03.437733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-33e3bed8-d8a4-496d-be5b-91cf2d1682a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:03.447163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:03.488697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185e41-588e-407e-a495-47be391e0ed6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:03.501216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185e41-588e-407e-a495-47be391e0ed6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:03.505477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:03.506127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:03.506475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:03.506751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:03.516811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:03.518315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6edaa-831a-440e-96dd-84125396a7ef service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:03.528576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 732/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:06.016719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c1f6-2b0d-42a2-a566-f4ad81401591 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:06.017587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c1f6-2b0d-42a2-a566-f4ad81401591 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:06.017788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c1f6-2b0d-42a2-a566-f4ad81401591 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:06.019910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:06.025902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8d0c-62e4-4bd8-99f4-fab89fb62196 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:06.026801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8d0c-62e4-4bd8-99f4-fab89fb62196 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:06.026801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc8d0c-62e4-4bd8-99f4-fab89fb62196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:06.046921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a8fc8d0c-62e4-4bd8-99f4-fab89fb62196 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:06.048273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8fc8d0c-62e4-4bd8-99f4-fab89fb62196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:06.056762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:58:06.095031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c1f6-2b0d-42a2-a566-f4ad81401591 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:06.112758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c1f6-2b0d-42a2-a566-f4ad81401591 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:06.117330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:06.117987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:06.118259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:06.118526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:06.128962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:06.133151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa7f3d-b6f6-4c52-aea1-a17057c4f0e6 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:06.145795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 713/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:08.778829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512f55-a242-4519-9cf9-c352d79f7092 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:08.779440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512f55-a242-4519-9cf9-c352d79f7092 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:08.779440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512f55-a242-4519-9cf9-c352d79f7092 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:08.780891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:08.786341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9013-7a0e-413b-bc88-7dffc4c97f8f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:08.786844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9013-7a0e-413b-bc88-7dffc4c97f8f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:08.786949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a9013-7a0e-413b-bc88-7dffc4c97f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:08.805353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ab5a9013-7a0e-413b-bc88-7dffc4c97f8f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:08.806599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab5a9013-7a0e-413b-bc88-7dffc4c97f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:08.815539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:08.857538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512f55-a242-4519-9cf9-c352d79f7092 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:08.868953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512f55-a242-4519-9cf9-c352d79f7092 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:08.872598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:08.873241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:08.873542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:08.873813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:08.884053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:08.885619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f8b43-7001-45ed-8ccb-adf50f0eab89 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:08.895725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 735/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:11.310087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5432f0-fb89-476e-ba3e-ecc0b05236b2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:11.310673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5432f0-fb89-476e-ba3e-ecc0b05236b2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:11.310673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5432f0-fb89-476e-ba3e-ecc0b05236b2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:11.312098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:11.317815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3708f-82f0-4d30-84f8-827b8aef3bda None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:11.318316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3708f-82f0-4d30-84f8-827b8aef3bda None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:11.318316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3708f-82f0-4d30-84f8-827b8aef3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:11.338386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d0a3708f-82f0-4d30-84f8-827b8aef3bda None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:11.339596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d0a3708f-82f0-4d30-84f8-827b8aef3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:11.347774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:11.387106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5432f0-fb89-476e-ba3e-ecc0b05236b2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:11.398984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5432f0-fb89-476e-ba3e-ecc0b05236b2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:11.402690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:11.403326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:11.403601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:11.403873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:11.413875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:11.415320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13320da-7565-4b93-93a3-0cbefd7778c7 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:11.425387 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 716/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:13.848278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508b83-9d44-4705-b827-73e42b409ff2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:13.848892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508b83-9d44-4705-b827-73e42b409ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:13.848892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508b83-9d44-4705-b827-73e42b409ff2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:13.850180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:13.856115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d26715-373b-4c5d-a43b-c6fa8925540e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:13.856584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d26715-373b-4c5d-a43b-c6fa8925540e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:13.856687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d26715-373b-4c5d-a43b-c6fa8925540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:13.875343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-15d26715-373b-4c5d-a43b-c6fa8925540e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:13.876594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-15d26715-373b-4c5d-a43b-c6fa8925540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:13.885102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:13.923424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508b83-9d44-4705-b827-73e42b409ff2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:13.935597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508b83-9d44-4705-b827-73e42b409ff2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:13.940132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:13.940664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:13.940999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:13.941271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:13.951626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:13.953114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881666-256c-4f6c-b11e-b32fc987a8f8 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:13.963357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 738/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:16.314510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f1be1-20d3-4ace-9546-a057b5484f12 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:16.315755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f1be1-20d3-4ace-9546-a057b5484f12 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:16.315755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f1be1-20d3-4ace-9546-a057b5484f12 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:16.316819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:16.323121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f737ef-17c9-41aa-8b40-3fc1aacb0a28 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:16.323727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f737ef-17c9-41aa-8b40-3fc1aacb0a28 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:16.323727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f737ef-17c9-41aa-8b40-3fc1aacb0a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:16.342904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-05f737ef-17c9-41aa-8b40-3fc1aacb0a28 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:16.344147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-05f737ef-17c9-41aa-8b40-3fc1aacb0a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:16.352329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:16.391013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f1be1-20d3-4ace-9546-a057b5484f12 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:16.403153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f1be1-20d3-4ace-9546-a057b5484f12 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:16.407022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:16.407676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:16.407948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:16.408458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:16.418075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:16.419524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9879-5fc3-42df-b4aa-ce63b14a403b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:16.429210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 719/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:18.740504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834b63c-f551-48d2-8f5e-b2ad47b79064 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:18.741064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834b63c-f551-48d2-8f5e-b2ad47b79064 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:18.741064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834b63c-f551-48d2-8f5e-b2ad47b79064 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:18.742332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:18.747880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecfe8-98e0-49a3-872a-55cb0ceac91a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:18.748354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecfe8-98e0-49a3-872a-55cb0ceac91a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:18.748465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecfe8-98e0-49a3-872a-55cb0ceac91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:18.755246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=70 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:58:18.768691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-380ecfe8-98e0-49a3-872a-55cb0ceac91a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:18.769975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-380ecfe8-98e0-49a3-872a-55cb0ceac91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:18.778611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:18.816857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834b63c-f551-48d2-8f5e-b2ad47b79064 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:18.822681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=73 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:58:18.829641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834b63c-f551-48d2-8f5e-b2ad47b79064 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:18.835265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:18.836373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:18.836696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:18.837137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:18.848641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:18.850087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065bc9-d227-4e1b-94ba-88a904d7976c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:18.860123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 741/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:21.155588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749d9e-fc7e-4f03-b4f0-c32d976eab50 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:21.156226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749d9e-fc7e-4f03-b4f0-c32d976eab50 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:21.156226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749d9e-fc7e-4f03-b4f0-c32d976eab50 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:21.157548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:21.163784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0efaec-3757-4158-acc4-e3c770d7fb5f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:21.164305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0efaec-3757-4158-acc4-e3c770d7fb5f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:21.164440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0efaec-3757-4158-acc4-e3c770d7fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:21.184249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ec0efaec-3757-4158-acc4-e3c770d7fb5f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:21.185447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ec0efaec-3757-4158-acc4-e3c770d7fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:21.193876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:21.232179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749d9e-fc7e-4f03-b4f0-c32d976eab50 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:21.244290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749d9e-fc7e-4f03-b4f0-c32d976eab50 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:21.248144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:21.248794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:21.249046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:21.249334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:21.258868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:21.260336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad051-da0d-4d76-ada8-515ba9d3b4ea service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:21.270238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 722/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:23.579750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b11e71-b80e-40f6-ab84-baa797689de6 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:23.580610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b11e71-b80e-40f6-ab84-baa797689de6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:23.580610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b11e71-b80e-40f6-ab84-baa797689de6 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:23.582261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:23.588869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852636-11af-4140-b3ee-f41b878b9cd8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:23.589394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852636-11af-4140-b3ee-f41b878b9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:23.589394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852636-11af-4140-b3ee-f41b878b9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:23.609971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e0852636-11af-4140-b3ee-f41b878b9cd8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:23.611828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e0852636-11af-4140-b3ee-f41b878b9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:23.621226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:23.659133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b11e71-b80e-40f6-ab84-baa797689de6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:23.671335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b11e71-b80e-40f6-ab84-baa797689de6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:23.675484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:23.676180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:23.676457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:23.676734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:23.686232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:23.687680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8fdd-3aaa-4f39-ae42-6dbac002d5f0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:23.697550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 744/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:26.025571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9edf-5f69-490a-91cb-81883289fd7d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:26.026196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9edf-5f69-490a-91cb-81883289fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:26.026196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de9edf-5f69-490a-91cb-81883289fd7d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:26.027483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 20:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:26.033256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57602112-f70e-40a6-b141-ed17abb55912 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:26.033712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57602112-f70e-40a6-b141-ed17abb55912 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:26.033806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57602112-f70e-40a6-b141-ed17abb55912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:26.053511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-57602112-f70e-40a6-b141-ed17abb55912 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:26.054722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-57602112-f70e-40a6-b141-ed17abb55912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:26.068370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:26.106280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de9edf-5f69-490a-91cb-81883289fd7d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:26.119827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de9edf-5f69-490a-91cb-81883289fd7d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:26.124347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:26.124986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:26.125261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:26.125529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:26.135460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:26.137057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bf953-18bf-4e4c-a560-3d3c02b306bc service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:26.146983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 725/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:58:36.047484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=17 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:58:36.142702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=17 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:58:57.893517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefaae2-2271-481a-9872-246ab01f76da None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:57.894168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefaae2-2271-481a-9872-246ab01f76da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:57.894168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefaae2-2271-481a-9872-246ab01f76da None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:57.895447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 746/1471] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 20:58:57.901310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2d37-4cba-4588-bba9-18c495418dd5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:57.901871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2d37-4cba-4588-bba9-18c495418dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:57.901871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2d37-4cba-4588-bba9-18c495418dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:57.921408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-775c2d37-4cba-4588-bba9-18c495418dd5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:57.923068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-775c2d37-4cba-4588-bba9-18c495418dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:57.932114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 726/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:57.981269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36d01-5443-46c1-9160-ce17fdf50727 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:57.981563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36d01-5443-46c1-9160-ce17fdf50727 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:57.981835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36d01-5443-46c1-9160-ce17fdf50727 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:57.983227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 747/1473] 10.222.0.33 () {54 vars in 962 bytes} [Mon Jun 6 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:58:57.988675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7691f-c6c7-4b90-af57-6052ca398aad None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:57.988962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7691f-c6c7-4b90-af57-6052ca398aad None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:57.989237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7691f-c6c7-4b90-af57-6052ca398aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:58.008472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-edc7691f-c6c7-4b90-af57-6052ca398aad None None] MFA Rules not processed for user `9cf17e40aeb64d3598124670b5981935`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:58:58.009659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-edc7691f-c6c7-4b90-af57-6052ca398aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:58:58.017366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 727/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Jun 6 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:58:58.024890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36d01-5443-46c1-9160-ce17fdf50727 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:58:58.037392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36d01-5443-46c1-9160-ce17fdf50727 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:58:58.041347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:58:58.042275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:58:58.042387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:58:58.042788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:58:58.054511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:58:58.055970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3276d-fff7-4812-99cf-8844a8efd0c3 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:58:58.066690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 748/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:00.422224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e34e-bd6f-4945-b89b-1761d2befb6b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:00.422909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e34e-bd6f-4945-b89b-1761d2befb6b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:00.422909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16e34e-bd6f-4945-b89b-1761d2befb6b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:00.424207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 728/1476] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:00.429592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ce-d538-46a5-b5f3-259d4ec20d1a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:00.430066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ce-d538-46a5-b5f3-259d4ec20d1a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:00.430179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fe6ce-d538-46a5-b5f3-259d4ec20d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:00.448938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-692fe6ce-d538-46a5-b5f3-259d4ec20d1a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:00.450140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-692fe6ce-d538-46a5-b5f3-259d4ec20d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:00.458389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 749/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:59:00.482680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16e34e-bd6f-4945-b89b-1761d2befb6b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:00.497202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16e34e-bd6f-4945-b89b-1761d2befb6b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:00.504233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:00.504899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:00.505180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:00.505438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:00.506183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:00.508009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:59:00.508009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 20:59:00.508009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 20:59:00.509172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf2fa4-88ee-46d9-9614-00819273f5c1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:00.529275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 729/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Jun 6 20:59:00 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 20:59:02.927095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b694f7-6042-41e9-9691-6d96ba34fcc2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:02.927714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b694f7-6042-41e9-9691-6d96ba34fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:02.927714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b694f7-6042-41e9-9691-6d96ba34fcc2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:02.929074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 750/1479] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:02.935190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b4c4-7189-4780-b98d-237b8ce92ef1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:02.935763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b4c4-7189-4780-b98d-237b8ce92ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:02.935763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b4c4-7189-4780-b98d-237b8ce92ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:02.961770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3e16b4c4-7189-4780-b98d-237b8ce92ef1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:02.962993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3e16b4c4-7189-4780-b98d-237b8ce92ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:02.971848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 730/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 20:59:03.028991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b694f7-6042-41e9-9691-6d96ba34fcc2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:03.046605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b694f7-6042-41e9-9691-6d96ba34fcc2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:03.065313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:03.065983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:03.066263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:03.066566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:03.078436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:03.080087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a814-8073-4066-99d5-872b0b9ca255 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:03.091132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 751/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:05.552309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25ffb8-3436-413b-8932-a315b1209f3c None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:05.552933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25ffb8-3436-413b-8932-a315b1209f3c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:05.552933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25ffb8-3436-413b-8932-a315b1209f3c None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:05.554251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 731/1482] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:05.560029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b5484-dc0b-4cb1-9d50-9d3fb3f827c0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:05.560502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b5484-dc0b-4cb1-9d50-9d3fb3f827c0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:05.560657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b5484-dc0b-4cb1-9d50-9d3fb3f827c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:05.582388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-de4b5484-dc0b-4cb1-9d50-9d3fb3f827c0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:05.583654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-de4b5484-dc0b-4cb1-9d50-9d3fb3f827c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:05.593358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 752/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:59:05.630780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25ffb8-3436-413b-8932-a315b1209f3c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:05.643713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25ffb8-3436-413b-8932-a315b1209f3c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:05.647796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:05.648474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:05.648758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:05.649027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:05.659976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:05.661461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1048-ea1b-4bc2-ae2c-b317be9d8a2e service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:05.671599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 732/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:07.997043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff394bc-edc0-4cae-a6eb-0ac70d640894 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:07.997621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff394bc-edc0-4cae-a6eb-0ac70d640894 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:07.997621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff394bc-edc0-4cae-a6eb-0ac70d640894 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:07.998963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 753/1485] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:08.005083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611bd5-4b24-4796-81d5-29c3521a7969 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:08.005557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611bd5-4b24-4796-81d5-29c3521a7969 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:08.005664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611bd5-4b24-4796-81d5-29c3521a7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:08.025083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-50611bd5-4b24-4796-81d5-29c3521a7969 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:08.026178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-50611bd5-4b24-4796-81d5-29c3521a7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:08.034966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 733/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:59:08.072551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff394bc-edc0-4cae-a6eb-0ac70d640894 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:08.083847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff394bc-edc0-4cae-a6eb-0ac70d640894 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:08.087884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:08.088560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:08.088841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:08.089121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:08.099012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:08.100521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a4ac-3f0e-41d7-a2fb-8f62d99ce44b service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:08.111250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 754/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:10.518158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383aaf-b913-4d13-873d-97ff4f7f87a2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:10.518793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383aaf-b913-4d13-873d-97ff4f7f87a2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:10.518793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383aaf-b913-4d13-873d-97ff4f7f87a2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:10.520228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 734/1488] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:10.525725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c25d8-74c4-4fcd-bd55-1005b9cfdaa0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:10.526215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c25d8-74c4-4fcd-bd55-1005b9cfdaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:10.526317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c25d8-74c4-4fcd-bd55-1005b9cfdaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:10.544518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-008c25d8-74c4-4fcd-bd55-1005b9cfdaa0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:10.545705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-008c25d8-74c4-4fcd-bd55-1005b9cfdaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:10.559588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 755/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:59:10.601724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383aaf-b913-4d13-873d-97ff4f7f87a2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:10.613235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383aaf-b913-4d13-873d-97ff4f7f87a2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:10.616971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:10.617603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:10.617880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:10.618212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:10.627506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:10.628982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09a30-cdea-4f8b-a0d3-0ac8956f7806 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:10.638402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 735/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:13.249104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583084-6298-4708-b74b-a7297c7ff3d7 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:13.249710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583084-6298-4708-b74b-a7297c7ff3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:13.249710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583084-6298-4708-b74b-a7297c7ff3d7 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:13.251162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 756/1491] 10.222.0.33 () {54 vars in 926 bytes} [Mon Jun 6 20:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 20:59:13.256873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4cc5a-0926-4e90-8683-7e0fe0ca467e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:13.257348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4cc5a-0926-4e90-8683-7e0fe0ca467e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:13.257467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4cc5a-0926-4e90-8683-7e0fe0ca467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:13.276343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e1f4cc5a-0926-4e90-8683-7e0fe0ca467e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 20:59:13.277546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e1f4cc5a-0926-4e90-8683-7e0fe0ca467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 20:59:13.287250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 736/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Mon Jun 6 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 20:59:13.326185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12583084-6298-4708-b74b-a7297c7ff3d7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 20:59:13.339249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12583084-6298-4708-b74b-a7297c7ff3d7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 20:59:13.343122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 20:59:13.344180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 20:59:13.344471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 20:59:13.344773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 20:59:13.354332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 20:59:13.355764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c19cc-c5e9-46f5-b628-140ecacda50a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 20:59:13.365910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 757/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 20:59:23.270849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=33 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:59:23.361489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=33 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:00:39.972623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:39.973301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:39.973301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:39.991768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:00:39.993011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:40.001553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 737/1494] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:00:40.009986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.010524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.010524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.030140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:00:40.031350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:40.040298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 758/1495] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:00:40.046296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.060095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba01f8-72cc-4a93-86ce-53010a7b902a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.067858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.068747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.069030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.069394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.070207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:00:40.070568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.071613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.071613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:00:40.071613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:00:40.072528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.086046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 738/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:00:40.094927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.104259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68654f-3567-432b-a3ba-8eba62e24d7c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.109233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.109895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.110173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.110449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.111211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.113007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.113007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:00:40.113007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:00:40.114097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.156058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 759/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:00:40.160644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.171506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691455-ee41-43a8-8746-ba6f36cdd043 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.230833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.231472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.231742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.232022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.232760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.233791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.233791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:00:40.233791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:00:40.235018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.256880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 739/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:00:40.261321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.272760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14c0d-183a-4e52-8adb-8a304de5b6a2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.277760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.279007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.279296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.279573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.280347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.281381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.281381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:00:40.281381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:00:40.282264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.296369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 760/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:00:40.300667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.311605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c089c-5e3d-4c1b-a4de-3500f3b9cbb8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.317422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.318092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.318375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.318617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.319346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.320485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.320485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:00:40.320485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:00:40.321408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd3663-591c-4bf4-bc98-a007238c5b9c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.336197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 740/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:00:40.340650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.351617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c9f1-5ed5-442d-8130-27de5fbd86ba admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.357203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.358104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.358384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.358661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] PATH_INFO: `/v3/projects/42f918bb1f6e4954a93630690fed7198/users/fdd4f443120b4366a08b34d67ef6bb4e/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.373921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f918bb1f6e4954a93630690fed7198, user_id=fdd4f443120b4366a08b34d67ef6bb4e, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.374967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.374967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:00:40.374967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:00:40.376923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d90c9-1dc5-44c1-bce9-11f0c614c6f5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.391885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 761/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:00:40 2022] PUT /identity/v3/projects/42f918bb1f6e4954a93630690fed7198/users/fdd4f443120b4366a08b34d67ef6bb4e/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:00:40.404906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97834328-5451-4991-a130-4a13185c9f74 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.405191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97834328-5451-4991-a130-4a13185c9f74 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.405466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97834328-5451-4991-a130-4a13185c9f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.433633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-97834328-5451-4991-a130-4a13185c9f74 None None] MFA Rules not processed for user `fdd4f443120b4366a08b34d67ef6bb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:00:40.435027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-97834328-5451-4991-a130-4a13185c9f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:40.510975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 741/1502] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:00:40.524554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a9948-9f9e-439d-8da5-e85828fd84ce None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.524843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a9948-9f9e-439d-8da5-e85828fd84ce None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.525119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a9948-9f9e-439d-8da5-e85828fd84ce None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.526516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 762/1503] 10.222.0.33 () {54 vars in 963 bytes} [Mon Jun 6 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:00:40.531493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0941-576e-4873-a3dc-fe2b6d80b599 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.531785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0941-576e-4873-a3dc-fe2b6d80b599 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.532087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0941-576e-4873-a3dc-fe2b6d80b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.551789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a3de0941-576e-4873-a3dc-fe2b6d80b599 None None] MFA Rules not processed for user `80cf9f259e6b448eafcf246c09f0ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:00:40.555220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a3de0941-576e-4873-a3dc-fe2b6d80b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:40.599031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:00:40.609148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 742/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:00:40.616934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a9948-9f9e-439d-8da5-e85828fd84ce None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.628575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a9948-9f9e-439d-8da5-e85828fd84ce None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.632520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.633201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.633484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.633757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.642677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.644148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.652971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 763/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:00:40.695394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477f9c-fed9-4a5c-a95c-809297d20605 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.695696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477f9c-fed9-4a5c-a95c-809297d20605 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.695973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477f9c-fed9-4a5c-a95c-809297d20605 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.697351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 743/1506] 10.222.0.33 () {52 vars in 829 bytes} [Mon Jun 6 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:00:40.701191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:40.767125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7eca-d6e4-4f03-994f-5639af182811 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:40.772298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:40.773184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.773464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.773739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] PATH_INFO: `/v3/users/fdd4f443120b4366a08b34d67ef6bb4e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.774982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd4f443120b4366a08b34d67ef6bb4e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:40.776039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:40.776039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:00:40.776039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:00:40.777253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:40.850782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd4f443120b4366a08b34d67ef6bb4e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:40.864461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd4f443120b4366a08b34d67ef6bb4e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:40.885592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd4f443120b4366a08b34d67ef6bb4e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:40.886441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd4f443120b4366a08b34d67ef6bb4e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:40.892008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:00:40.898836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd4f443120b4366a08b34d67ef6bb4e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:40.906622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 764/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:00:40 2022] DELETE /identity/v3/users/fdd4f443120b4366a08b34d67ef6bb4e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:00:40.911370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:40.911661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:40.911939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:40.933667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:00:40.935529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:40.998979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 744/1508] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:00:41.008891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:41.010575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:41.074790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539bff-0c6f-4de6-ae6f-6fa2b7f881a8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:41.080376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:41.081060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:41.081342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:41.081618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:41.093819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:41.095319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bea4-076d-4496-b530-4c4943e5a4b0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:41.105380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 765/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:00:41.442941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:00:41.444480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:00:41.456629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355458-4b84-4180-8e4b-7d51884735e6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:00:41.461816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:00:41.462728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:00:41.463006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:00:41.463279 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] PATH_INFO: `/v3/projects/42f918bb1f6e4954a93630690fed7198` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:00:41.464684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f918bb1f6e4954a93630690fed7198)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:00:41.465801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:00:41.465801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:00:41.465801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:00:41.467057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:00:41.538890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f918bb1f6e4954a93630690fed7198', 'request_id': 'req-42d8fb5b-9100-47fc-a8f8-2d14997cb193'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:41.560340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f918bb1f6e4954a93630690fed7198', 'request_id': 'req-42d8fb5b-9100-47fc-a8f8-2d14997cb193'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:41.568863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f918bb1f6e4954a93630690fed7198', 'request_id': 'req-42d8fb5b-9100-47fc-a8f8-2d14997cb193'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:41.587793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] The token cache is being invalidate because project 42f918bb1f6e4954a93630690fed7198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:00:41.588018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:41.588711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-42d8fb5b-9100-47fc-a8f8-2d14997cb193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:00:41.590411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 745/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:00:41 2022] DELETE /identity/v3/projects/42f918bb1f6e4954a93630690fed7198 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:00:51.100823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:00:51.583946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:22.450915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:22.451527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:22.451527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:22.452863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 21:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:22.458850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d990e-3744-43e9-864d-94f028fb9ad1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:22.460039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d990e-3744-43e9-864d-94f028fb9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:22.460511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d990e-3744-43e9-864d-94f028fb9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:22.485873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-552d990e-3744-43e9-864d-94f028fb9ad1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:22.487085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-552d990e-3744-43e9-864d-94f028fb9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:22.551715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:22.736436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:22.739715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:22.825827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18c61-7c1f-4628-aeaa-e27aed8ac009 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:22.832930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:22.833581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:22.833865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:22.834129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:22.843536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:22.845156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c67b-fadb-4902-aeb8-2f3789301dc7 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:22.855408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 767/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:23.540649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304479b-1669-4297-b408-51601cfa30b0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:23.541235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304479b-1669-4297-b408-51601cfa30b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:23.541235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304479b-1669-4297-b408-51601cfa30b0 None None] PATH_INFO: `/v3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:23.542546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 747/1514] 10.222.0.17 () {54 vars in 925 bytes} [Mon Jun 6 21:02:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:02:23.570762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb9ca-318f-48a9-bea3-df4586311ed1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:23.571349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb9ca-318f-48a9-bea3-df4586311ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:23.571349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb9ca-318f-48a9-bea3-df4586311ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:23.592510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d57fb9ca-318f-48a9-bea3-df4586311ed1 None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:23.593738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d57fb9ca-318f-48a9-bea3-df4586311ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:23.660421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 768/1515] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jun 6 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:23.770017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b93b-8ea1-491a-8ebf-1edd8541c50e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:23.770315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b93b-8ea1-491a-8ebf-1edd8541c50e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:23.770621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b93b-8ea1-491a-8ebf-1edd8541c50e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:23.772020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:23.777378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b8fd-85a2-4701-b49a-4e60a66f671f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:23.777670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b8fd-85a2-4701-b49a-4e60a66f671f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:23.777934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b8fd-85a2-4701-b49a-4e60a66f671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:23.798447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9b31b8fd-85a2-4701-b49a-4e60a66f671f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:23.799573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9b31b8fd-85a2-4701-b49a-4e60a66f671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:23.809611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:23.975877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b93b-8ea1-491a-8ebf-1edd8541c50e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:23.992627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b93b-8ea1-491a-8ebf-1edd8541c50e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:23.998940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:23.999591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:23.999872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:24.000184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:24.009583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:24.011156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e9da-8a16-46fb-b6b4-57d93ff7ff7b service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:24.021548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 749/1518] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:27.723472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d78f-ccff-43bd-87f5-a93c150144a2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:27.724237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d78f-ccff-43bd-87f5-a93c150144a2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:27.724237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d78f-ccff-43bd-87f5-a93c150144a2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:27.725444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 770/1519] 10.222.0.33 () {54 vars in 960 bytes} [Mon Jun 6 21:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 21:02:27.731753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e461658-30f6-4e26-a888-4da363a5e9b5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:27.732278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e461658-30f6-4e26-a888-4da363a5e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:27.732278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e461658-30f6-4e26-a888-4da363a5e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:27.751457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4e461658-30f6-4e26-a888-4da363a5e9b5 None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:27.752724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4e461658-30f6-4e26-a888-4da363a5e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:27.761454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 750/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Mon Jun 6 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:02:27.769197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8d78f-ccff-43bd-87f5-a93c150144a2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:27.784650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8d78f-ccff-43bd-87f5-a93c150144a2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:27.791940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:27.792759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:27.793038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:27.793319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:27.805311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:27.807063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3cde-5180-4b89-81dc-d25365770e98 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:27.818035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 771/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:35.342969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc313594-9a55-48b2-8798-f7e94416d9e6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:35.343670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc313594-9a55-48b2-8798-f7e94416d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:35.343670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc313594-9a55-48b2-8798-f7e94416d9e6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:35.345017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 21:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:35.349963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6bea-2012-44b8-864c-629bf9915e5b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:35.350444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6bea-2012-44b8-864c-629bf9915e5b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:35.350537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6bea-2012-44b8-864c-629bf9915e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:35.369825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1c0a6bea-2012-44b8-864c-629bf9915e5b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:35.371571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1c0a6bea-2012-44b8-864c-629bf9915e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:35.380061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:35.535592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc313594-9a55-48b2-8798-f7e94416d9e6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:35.555031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc313594-9a55-48b2-8798-f7e94416d9e6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:35.562343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:35.563007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:35.563283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:35.563549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:35.572721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:35.574584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f04c2-4f0d-4004-88b2-fcfbcaed678a service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:35.584818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 752/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:36.466629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25201-be71-4fc9-b599-91c055cc8979 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:36.467173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25201-be71-4fc9-b599-91c055cc8979 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:36.467173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25201-be71-4fc9-b599-91c055cc8979 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:36.468512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 21:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:36.473622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a21d-98d0-4e39-943d-80c09c8f2fd5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:36.474105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a21d-98d0-4e39-943d-80c09c8f2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:36.474211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a21d-98d0-4e39-943d-80c09c8f2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:36.494139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3b40a21d-98d0-4e39-943d-80c09c8f2fd5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:36.495341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3b40a21d-98d0-4e39-943d-80c09c8f2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:36.503636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:02:36.661753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25201-be71-4fc9-b599-91c055cc8979 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:36.677863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25201-be71-4fc9-b599-91c055cc8979 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:36.684221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:36.684886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:36.685142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:36.685432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:36.694809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:36.696497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d9c22-db23-4c18-98f0-109d01f94ead service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:36.707724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 774/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:40.906875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:40.907497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:40.907497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:40.908844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:40.914525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1cac-af8b-4fd9-a023-16dda99e5f6d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:40.914957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1cac-af8b-4fd9-a023-16dda99e5f6d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:40.915079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1cac-af8b-4fd9-a023-16dda99e5f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:40.939254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-844b1cac-af8b-4fd9-a023-16dda99e5f6d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:40.940492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-844b1cac-af8b-4fd9-a023-16dda99e5f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:40.949674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:40.994032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:40.997012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:41.063776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a40d-a5a5-4a5b-9099-924cb2e292dc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:41.067538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:41.068216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:41.068477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:41.068763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:41.078691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:41.080156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8bdca-3a07-4f06-9723-d37948d8e20c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:41.092117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 755/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:43.387180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c3db-3f52-4913-84c9-357b4a4bed75 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:43.387707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c3db-3f52-4913-84c9-357b4a4bed75 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:43.387707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c3db-3f52-4913-84c9-357b4a4bed75 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:43.389117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 21:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:43.398134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8ec4-230f-4265-a25c-a3f32d0e8e8e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:43.398832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8ec4-230f-4265-a25c-a3f32d0e8e8e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:43.399008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8ec4-230f-4265-a25c-a3f32d0e8e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:43.425708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-072c8ec4-230f-4265-a25c-a3f32d0e8e8e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:43.426926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-072c8ec4-230f-4265-a25c-a3f32d0e8e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:43.436629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:43.473186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c3db-3f52-4913-84c9-357b4a4bed75 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:43.487029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c3db-3f52-4913-84c9-357b4a4bed75 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:43.491710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:43.492397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:43.492681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:43.492959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:43.503644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:43.505118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e6b7-28f9-48f1-8d3c-9c18e4d95ab0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:43.515821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 777/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:47.164728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:47.165511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:47.165511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:47.166756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:47.172302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3caa5-a3db-4c5d-af62-8ed517b03166 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:47.172766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3caa5-a3db-4c5d-af62-8ed517b03166 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:47.172871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3caa5-a3db-4c5d-af62-8ed517b03166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:47.197873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c1b3caa5-a3db-4c5d-af62-8ed517b03166 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:47.199178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c1b3caa5-a3db-4c5d-af62-8ed517b03166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:47.210237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:47.486045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:47.488164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:47.554537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b3840-b890-4317-b367-fa21aaf0b31b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:47.558518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:47.559172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:47.559454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:47.559732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:47.569110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:47.570545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4d970-d731-462f-ba38-2c00f11be6e6 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:47.575524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:47.580786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 758/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:49.875935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:49.876880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:49.876880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:49.878987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 21:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:02:49.884540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc2db-9e1d-4bcd-9fcc-70d46c51c80b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:49.885003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc2db-9e1d-4bcd-9fcc-70d46c51c80b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:49.885107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc2db-9e1d-4bcd-9fcc-70d46c51c80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:49.906062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8b9fc2db-9e1d-4bcd-9fcc-70d46c51c80b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:02:49.907257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8b9fc2db-9e1d-4bcd-9fcc-70d46c51c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:49.915705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:02:50.195683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:02:50.198751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:02:50.215365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a841-9811-4056-9a96-2dceae386163 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:02:50.219576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:02:50.220258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:02:50.220625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:02:50.220925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:02:50.231124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:02:50.232598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43f9d0-deb9-4fa4-be7b-ef465dc2ee3c service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:02:50.242492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 780/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:02:59.899769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:03:00.238363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:25.614336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:25.615109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:25.615109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:25.646839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:25.648408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:25.668592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 760/1540] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:25.679364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:25.680267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:25.680755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:25.713385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:25.715171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:25.730494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 781/1541] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:25.734958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:25.751495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb146-d14f-4c37-9ca4-93ad4394bbff None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:25.761510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:25.762246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:25.762544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:25.762797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:25.763544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:25.763848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:25.765805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:25.786127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 761/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:25.798180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:25.810518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4eca-1213-43dd-b65b-24b47485b237 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:25.821742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:25.822876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:25.823468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:25.824090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:25.825110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:25.827453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:25.872240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 782/1543] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:25 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:25.876128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:25.894678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdf00a-9eba-45c9-a82a-e2ccf4d2c535 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:25.982424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:25.983143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:25.983425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:25.983698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:25.984679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:25.986725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.029882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 762/1544] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:25 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:26.034620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.065608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0601-acae-4f74-9fbb-64b836ee397a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:26.076390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:26.077722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.078489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.079007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.080055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:26.082701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.103324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 783/1545] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:26.107793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.137093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0407d4-f86e-455e-b476-6fe94d397091 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:26.149131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:26.150161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.150585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.150987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.152271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:26.155134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a31ef-581e-4f6f-938a-fabe7aec0754 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.174146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 763/1546] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:26.178815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.206884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c201b6-3cec-4379-b933-2b6234b5637c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:26.219439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50524085-f957-426c-8499-18adef8be029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:26.220856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524085-f957-426c-8499-18adef8be029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.221541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524085-f957-426c-8499-18adef8be029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.222069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524085-f957-426c-8499-18adef8be029 admin admin] PATH_INFO: `/v3/projects/84a495ebc66440419f2475ab298ef29a/users/e1ce45ce4783427e8ee91607e9fcc7a3/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.246252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50524085-f957-426c-8499-18adef8be029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a495ebc66440419f2475ab298ef29a, user_id=e1ce45ce4783427e8ee91607e9fcc7a3, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:26.250065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50524085-f957-426c-8499-18adef8be029 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.284501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 784/1547] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:26 2022] PUT /identity/v3/projects/84a495ebc66440419f2475ab298ef29a/users/e1ce45ce4783427e8ee91607e9fcc7a3/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:26.300948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716892-a8cd-4aea-8d3b-20d4cc73e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.301336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716892-a8cd-4aea-8d3b-20d4cc73e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.301655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716892-a8cd-4aea-8d3b-20d4cc73e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.360076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9c716892-a8cd-4aea-8d3b-20d4cc73e3c3 None None] MFA Rules not processed for user `e1ce45ce4783427e8ee91607e9fcc7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.361355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9c716892-a8cd-4aea-8d3b-20d4cc73e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.377640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3045d7-3e52-4749-8522-91810bd91283 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.394304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3045d7-3e52-4749-8522-91810bd91283 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.395306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3045d7-3e52-4749-8522-91810bd91283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.434200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5c3045d7-3e52-4749-8522-91810bd91283 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.441215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5c3045d7-3e52-4749-8522-91810bd91283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.534095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 764/1548] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.585394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095797a8-319e-4934-8d71-eff76abac244 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.586047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095797a8-319e-4934-8d71-eff76abac244 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.586586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095797a8-319e-4934-8d71-eff76abac244 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.592566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 765/1549] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 6 21:04:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:26.607658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 785/1550] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.618528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fc04-2a6f-4120-ad6d-fa352be3cfce None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.620913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fc04-2a6f-4120-ad6d-fa352be3cfce None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.621669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fc04-2a6f-4120-ad6d-fa352be3cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.637678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7637e-aace-479f-8bfe-599acb92e8ca None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.638049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7637e-aace-479f-8bfe-599acb92e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.638281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7637e-aace-479f-8bfe-599acb92e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.666163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3df7fc04-2a6f-4120-ad6d-fa352be3cfce None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.667841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3df7fc04-2a6f-4120-ad6d-fa352be3cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.680272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fdf7637e-aace-479f-8bfe-599acb92e8ca None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.681563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fdf7637e-aace-479f-8bfe-599acb92e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.707193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 766/1551] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.709123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.709682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.710187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.742607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.744348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.765985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 767/1552] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.767867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.796059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a589-38d1-4633-81a1-8024ff7195fc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:26.802120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:26.803491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.804232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.804781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.806170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:26.806788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:26.816410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51f13e-64ef-4c02-adf0-0daa217bfbf1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.838087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 768/1553] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:26.839954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f25f36-8113-4c25-9cfe-f6f30e6ec753 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.840911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f25f36-8113-4c25-9cfe-f6f30e6ec753 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.841459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f25f36-8113-4c25-9cfe-f6f30e6ec753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.858070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 786/1554] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.859716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699221-f320-4489-896e-76b522f1b6d8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.860166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699221-f320-4489-896e-76b522f1b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.860487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699221-f320-4489-896e-76b522f1b6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.865497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-49f25f36-8113-4c25-9cfe-f6f30e6ec753 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.867162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-49f25f36-8113-4c25-9cfe-f6f30e6ec753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.876682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 769/1555] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.878493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.879113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.879578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.901879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.904160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.911743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3d699221-f320-4489-896e-76b522f1b6d8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.915349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3d699221-f320-4489-896e-76b522f1b6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.917205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 770/1556] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.920109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.939266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 787/1557] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.940703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c479e-fa80-413f-babb-d4b2d7b95b70 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:26.940904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.941190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.941336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.947254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:26.948487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:26.948978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:26.949598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:26.952062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:26.954215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:04:26.954215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:04:26.954215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:04:26.956763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:26.963263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:26.971334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:26.972756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:26.981872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 788/1558] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:26.985290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:26.998358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 771/1559] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:26 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:26.998358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.005088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69574b-8eb6-4d14-8d2d-b0fea99cdc20 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.020728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.080935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743e19-0499-4ed3-b72b-7b78f8116b86 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.087267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.088609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.089067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.089559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.090520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:27.090828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.092536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd21d-e614-4969-ae3f-e67e661f6ffe admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.099316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.100116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.101154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.101501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.106306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 772/1560] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:27.107465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946f30-c066-4975-b75a-d893a185704e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.107751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946f30-c066-4975-b75a-d893a185704e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.108077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42946f30-c066-4975-b75a-d893a185704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.127472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-42946f30-c066-4975-b75a-d893a185704e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.128751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-42946f30-c066-4975-b75a-d893a185704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.137240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 773/1561] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.138383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20f39-0b82-43b9-a936-fc60e4551fc6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.138667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20f39-0b82-43b9-a936-fc60e4551fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.138936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20f39-0b82-43b9-a936-fc60e4551fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.159595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9bf20f39-0b82-43b9-a936-fc60e4551fc6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.161910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9bf20f39-0b82-43b9-a936-fc60e4551fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.177664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 774/1562] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.179012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.179348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.180046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.201231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.202366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.202630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.204907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.213286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 775/1563] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.214956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.220639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 789/1564] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:27.222027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.232462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22cbd-4893-4576-b3c7-79bd89a46643 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.239710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.240498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6cb1-8166-482a-b7f1-764080a759fc service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.240794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.241226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.241679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.242971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:27.243488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.246493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.247849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.248942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.249301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.249790 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.250981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.252652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:04:27.252652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:04:27.252652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:04:27.254787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade0d-553d-4d47-a06f-f197414b9eed admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.269419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 776/1565] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:27.272052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.291421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399126-805a-4b63-b428-e99d04dc4bf2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.300515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 790/1566] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.300515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1debe5-d6b4-4e7a-8291-9dfcabe7a217 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.300515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1debe5-d6b4-4e7a-8291-9dfcabe7a217 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.300515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1debe5-d6b4-4e7a-8291-9dfcabe7a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.302182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.303519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.304105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.304646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.305927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.309590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c545e5-e596-44f4-ad9f-120187bbec7c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.334084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ad1debe5-d6b4-4e7a-8291-9dfcabe7a217 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.335983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ad1debe5-d6b4-4e7a-8291-9dfcabe7a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.349376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 791/1567] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.358234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.358766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.359322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.359964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 777/1568] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/projects => generated 403 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.362446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.363000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.363534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.387028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.388642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.389118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.390631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.484223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 778/1569] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.485627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.492434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 792/1570] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.493396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.506067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c1f3-a1ee-4359-9f8d-f22163b50181 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.506314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d8ea-090e-4f28-8d99-2da95e45c4cb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.512985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.513671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552163-539d-4487-acc4-09524424990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.514366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.514731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552163-539d-4487-acc4-09524424990f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.515070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.515223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552163-539d-4487-acc4-09524424990f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.515634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552163-539d-4487-acc4-09524424990f admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.516776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.517078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552163-539d-4487-acc4-09524424990f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:27.517586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552163-539d-4487-acc4-09524424990f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.518571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.520602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552163-539d-4487-acc4-09524424990f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.523330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.542315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 779/1571] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:27.543844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552163-539d-4487-acc4-09524424990f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.559008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552163-539d-4487-acc4-09524424990f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.566582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.567521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.568095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.568437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.569338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.575528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 793/1572] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.575851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.576045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.589054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.594151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 780/1573] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:27.594151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.600844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.609033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ae83-0d96-4221-9e09-93b49e0c57ac admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.692399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.693086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5cee-8f43-4e13-a040-c904acf8e49f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.693493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.693786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.694319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.695535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.699115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d0c5-2edc-4617-b477-fa16b49c694c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.701096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.702159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.702603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.703104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.704281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:27.705059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.707592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:04:27.707592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:04:27.707592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:04:27.709178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.731162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 794/1574] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:27.732218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.748969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 781/1575] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.748969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.748969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.748969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.751316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822019bb-44ef-4701-9477-dd8e03803c16 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.756992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.757700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.757981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.758255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.770486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:27.770486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.770486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.782538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:27.784502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:27.799609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 782/1576] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:27.800757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.805161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 795/1577] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:27.806985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.823849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc223-17ea-4a53-9867-d870a32e8ca7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.830639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e8d2-1588-416a-8cca-ea193be7f009 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.831061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.832061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.832386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.832799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.833747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.835720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.838628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.839523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.840154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.840573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.842046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.845307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.873233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 783/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.874679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.877611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 796/1579] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/users => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:27.878955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:27.890004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8689ce-574c-4fde-870a-493a1d14c22f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.972127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647739-0161-4bc9-bb40-64d307a218f1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:27.980468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.981225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.981499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.981777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.982700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.987114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:27.994386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:27.995372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:27.995655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:27.995932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:27.997256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:27.999590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.004782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 784/1580] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.005949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.020098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcbe4-fc41-479b-a2f3-28278d57100f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.027390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.028590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.028963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.029396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.030573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.034050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.050494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 797/1581] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:27 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.051339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.059342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 785/1582] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.061175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.077023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3263-8d2d-4347-9bc7-f63f4856bf38 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.155242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:28.156974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:28.166120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489f7-568a-4d8c-9bd5-bd73b333fd97 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.174864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.175891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.176367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.176816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.178085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:28.178564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.178819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.179808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.180284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.180728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.181476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789e2ef-48b8-40a5-a4ad-29b1641e6904 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.181887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.185254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 798/1583] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda49cb-cb60-47f5-a528-247d1176ab06 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda49cb-cb60-47f5-a528-247d1176ab06 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda49cb-cb60-47f5-a528-247d1176ab06 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 799/1584] 10.222.0.33 () {54 vars in 961 bytes} [Mon Jun 6 21:04:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:28.214056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda49cb-cb60-47f5-a528-247d1176ab06 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.232103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 786/1585] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.234695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.238165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda49cb-cb60-47f5-a528-247d1176ab06 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.330979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.332086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.332572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.333018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.334187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.337653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.340580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251823e3-8883-421e-9ec5-751fad317aa0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.348811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.349888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.350322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.350770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.352026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.354729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.370334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 787/1586] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.371774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.376188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 800/1587] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.376188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.385777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563345-f0be-4576-8fd9-c1dab6240fa1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.392256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.392615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e14a3-956d-4a4d-a400-1de2e2e4bf0e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.393893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.394401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.394892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] PATH_INFO: `/v3/projects/5a771f1ab27f40aca2d546901cdcecda/users/8713cb23a93147f8b52f88e240c81d6f/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.398257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.399108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.399534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.399883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.401062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.403458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.417692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a771f1ab27f40aca2d546901cdcecda, user_id=8713cb23a93147f8b52f88e240c81d6f, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.419300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:04:28.419300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:04:28.419300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:04:28.423261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.431538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 801/1588] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.433009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.444802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 788/1589] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:28 2022] PUT /identity/v3/projects/5a771f1ab27f40aca2d546901cdcecda/users/8713cb23a93147f8b52f88e240c81d6f/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:28.445850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.448773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941449bf-390a-4497-add1-96915cffdde4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.530555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.531662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.532213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.532735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.533989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.535759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bb459-3abb-4633-b711-cbf1df678ca9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.540243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500a8b-9962-425e-8580-66fc6c883a96 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.547183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.548130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.548416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.548693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.549424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.550235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 802/1590] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.551419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.551942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.552437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.553017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.584183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:28.585654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:28.595167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 789/1591] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.596601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.649272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:28.660780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:28.681744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 803/1592] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:28.683375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.701223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f2390-23c4-4b42-92e0-2d21a7e78385 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.705739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61c4d6-0cfa-4a24-852a-cf6b38ece703 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.710071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.711168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.711350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.711743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.711935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.712167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.712311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.712489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.713171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.713655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.715187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.716679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.737166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 804/1593] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.738613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.742123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 790/1594] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.742884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.754555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9eb1b-5e60-480a-80e6-dc2234b4e217 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.757671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30f00b-9ed4-467e-9365-d14e347cea1e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.759710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.760437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.760720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.760993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.761776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.763595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12608d46-2c88-45c6-b5f0-de3f80922b4c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.766680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.767743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.768297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.768798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.770231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.773425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.779144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 791/1595] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.779144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.779144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.779144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.794300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 805/1596] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:28.796212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.800588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:28.801957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:28.811001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc84e9-64da-4041-9f46-79d522be286d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.812333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 792/1597] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:28.813948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.820450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.822166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.822846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.823982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] PATH_INFO: `/v3/projects/522b8c683a104408805d7f7b39aff791/users/6820d811edde41c78884cf989347b0f4/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.832617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275d75-a5e1-4432-bc06-854702bafbfa None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.840187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.841025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.841455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.841870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.842752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.845482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.850975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b8c683a104408805d7f7b39aff791, user_id=6820d811edde41c78884cf989347b0f4, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.854606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653577c4-1beb-4139-9975-475cec2ab3fb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:28.875024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 806/1599] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:28 2022] PUT /identity/v3/projects/522b8c683a104408805d7f7b39aff791/users/6820d811edde41c78884cf989347b0f4/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:28.875551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 793/1599] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:28 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:28.877341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.877578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c554-284b-4391-9aed-fd44b21f6853 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.878054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c554-284b-4391-9aed-fd44b21f6853 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.878507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c554-284b-4391-9aed-fd44b21f6853 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.880633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 807/1600] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 6 21:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:28.881946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100c554-284b-4391-9aed-fd44b21f6853 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:28.895021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237606-c06f-4f75-96e6-92c10b0d61fa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.984496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.985851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100c554-284b-4391-9aed-fd44b21f6853 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:28.986204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.986675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.987116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] PATH_INFO: `/v3/projects/c1a4dae8c2004be29cd9abd52fac2269/users/ebbccef7f2ea4ddfbac2722bd2d0af24/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.993401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:28.994429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:28.994875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:28.995320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:28.996655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:28.999672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.014863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a4dae8c2004be29cd9abd52fac2269, user_id=ebbccef7f2ea4ddfbac2722bd2d0af24, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.019449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 808/1601] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.019983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.020873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.035465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f218d5c-c7b3-4cd2-a6dd-00235d084c50 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.044636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 794/1602] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:28 2022] PUT /identity/v3/projects/c1a4dae8c2004be29cd9abd52fac2269/users/ebbccef7f2ea4ddfbac2722bd2d0af24/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:29.046750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.143013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a5c-ce12-4b79-877a-c6c8d62b4fc0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.145463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.146604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.147099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.147506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.148680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.148981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.149716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.150208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.150676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.151348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.151576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.153585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.166778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 795/1603] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.167457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.172072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 809/1604] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.173369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.180016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:29.191580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ab3d-6b44-44ad-a145-a10a48a34463 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.198334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.199047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.199906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.199906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.200378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.202066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cb93-0c6f-4f4c-8fd1-3281af5b256d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.215717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 810/1605] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.217139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaec-26a0-40aa-b708-b9571bdec274 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.217430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaec-26a0-40aa-b708-b9571bdec274 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.217708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaec-26a0-40aa-b708-b9571bdec274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.239569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-da73aaec-26a0-40aa-b708-b9571bdec274 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:29.240883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-da73aaec-26a0-40aa-b708-b9571bdec274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:29.250846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 811/1606] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:29.252299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.252585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.252861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.257909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0bfd-b029-4184-8cea-fa8df87dde32 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.264714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.267059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.267404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.267736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.276672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:29.277925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:29.281327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.284371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.294044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:29.303817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 796/1607] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:29.309604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.328710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538c52-f78b-4e29-8500-085e244ab424 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.336456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.337555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.338012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.338456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.339816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.342469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d038ae-3be3-4975-850d-7ba02abdde8a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.363763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 797/1608] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.363763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.363763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.363763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.403789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 812/1609] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:29.405233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.408954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] MFA Rules not processed for user `ebbccef7f2ea4ddfbac2722bd2d0af24`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:29.410974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:29.427972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b31eb7-91a1-4f86-bce1-e81de00c25c8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.437309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.439234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.439714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.440293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] PATH_INFO: `/v3/projects/90f13837d6544b8da91f4096d004b865/users/6cf73a8aad884c9a9345398b8a6405fc/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.472465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f13837d6544b8da91f4096d004b865, user_id=6cf73a8aad884c9a9345398b8a6405fc, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.476064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.501002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 813/1610] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:29 2022] PUT /identity/v3/projects/90f13837d6544b8da91f4096d004b865/users/6cf73a8aad884c9a9345398b8a6405fc/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:29.502993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.570369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 798/1611] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:29.572237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.602176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7be449-89dd-4b2f-ad64-deaa76d35278 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.632410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e534-3e5e-4db6-be24-6973f99c21ab admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.641896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.648163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.648163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.648163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] PATH_INFO: `/v3/projects/26d748716671444a9c507a0528faadd0/users/2d979de65f3a4cc48a1f1c9d6c803638/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.684202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d748716671444a9c507a0528faadd0, user_id=2d979de65f3a4cc48a1f1c9d6c803638, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.691015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.720133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 814/1612] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:29 2022] PUT /identity/v3/projects/26d748716671444a9c507a0528faadd0/users/2d979de65f3a4cc48a1f1c9d6c803638/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:29.721679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.723752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.725799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.726545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.727262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.729034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.731033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:29.734760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.757119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 799/1613] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:29.759182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:29.780879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989df5-bc5b-4394-97de-5b7f6477b80b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.828976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:29.838702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a09fb7-04d9-418e-a9ce-47dd939cef18 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:29.851076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.852720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.853197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.853671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.906688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:29.922892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:29.925059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:29.925750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:29.926362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] PATH_INFO: `/v3/projects/cdd447d1ebbf403bbf62efc88834bdca/users/39d92849843e49e7833f03ca38cb8367/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:29.965234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd447d1ebbf403bbf62efc88834bdca, user_id=39d92849843e49e7833f03ca38cb8367, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.971934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:29.973305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa82fe-1c03-4adc-92f0-2c8edde79d7a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.973755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:29.991680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 815/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:29.995599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:30.005138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 800/1615] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:29 2022] PUT /identity/v3/projects/cdd447d1ebbf403bbf62efc88834bdca/users/39d92849843e49e7833f03ca38cb8367/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:30.006765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.007050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.007369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.054431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] MFA Rules not processed for user `6cf73a8aad884c9a9345398b8a6405fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:30.055708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:30.172437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817865fc-7146-4e01-90db-c5f754a82d87 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:30.228557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 801/1616] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:30.232130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:30.295109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:30.296391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.297042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.297872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.470534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2add-1b6d-4dfc-bf61-358c74589aa9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:30.490213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:30.491807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0fd2d-acf2-45fb-8590-202c8ebf686e service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:30.501667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:30.503210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.504035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.504618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.529456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 816/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:30.531461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.531750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.532055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.603553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] MFA Rules not processed for user `2d979de65f3a4cc48a1f1c9d6c803638`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:30.604863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:30.614902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:30.659006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:30.748332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:30.752793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2779-347d-4c81-95a7-b8f307a06abb service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:30.763399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 817/1618] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:30.764542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:30.817064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 802/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:30.822081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.824726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.825264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.912557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869efa5d-c008-4a27-9106-91a3c6b77641 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:30.922313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:30.925149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:30.926069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:30.926915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] PATH_INFO: `/v3/projects/576ccf22c37f44fcbe449838cb5673f6/users/602aaa469bed4617b1a0385087066c93/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:30.942275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:30.944619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:30.981890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=576ccf22c37f44fcbe449838cb5673f6, user_id=602aaa469bed4617b1a0385087066c93, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:30.985781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 803/1620] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:30.987675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.000520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e29a30-8689-4e57-a81f-b37e0fd82465 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.002402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.006123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.006820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.007102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.007379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.008358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.010555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa565b-f526-48a4-b7f7-c963979d92bd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.061719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 818/1621] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:30 2022] PUT /identity/v3/projects/576ccf22c37f44fcbe449838cb5673f6/users/602aaa469bed4617b1a0385087066c93/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:31.061719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.086175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 804/1622] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:30 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:31.087744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f52696-6cc9-4f5f-88f5-24373f3f3cab None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.088194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f52696-6cc9-4f5f-88f5-24373f3f3cab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.088549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f52696-6cc9-4f5f-88f5-24373f3f3cab None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.090725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 805/1623] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 6 21:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:31.091972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f52696-6cc9-4f5f-88f5-24373f3f3cab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.182386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f52696-6cc9-4f5f-88f5-24373f3f3cab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.188278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d40a7-0e36-4ff0-8379-95682f3e65ac admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.192775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.194372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.195258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.196178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.248376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:31.267046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.270080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.270080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.270500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.353778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.357673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1629c1-32f7-4a32-ad17-eb774e4cc9d0 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.381074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 806/1624] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:31.383592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.385623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.386112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.386632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.387506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.412284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 819/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:31.413987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.423662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:31.426405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:31.436897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c87a-c2bf-4769-86a4-da66d443fb6a service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.443650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.444212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 807/1626] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:31.446033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.448671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.449071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.449460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] PATH_INFO: `/v3/users/e1ce45ce4783427e8ee91607e9fcc7a3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.453311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ce45ce4783427e8ee91607e9fcc7a3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.457347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.469968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f041-751f-4225-b95d-4c36d589e429 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.480849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.482664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.483541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.484361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.486179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.490879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820be3a-f516-49b2-b690-3fe0837ddf09 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:31.541135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 808/1627] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:31 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:31.544341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.545199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.547464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.556363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ce45ce4783427e8ee91607e9fcc7a3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:31.571110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ce45ce4783427e8ee91607e9fcc7a3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:31.599239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ce45ce4783427e8ee91607e9fcc7a3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:31.600263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ce45ce4783427e8ee91607e9fcc7a3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:31.615890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ce45ce4783427e8ee91607e9fcc7a3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:31.627538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:31.637394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 820/1628] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:31 2022] DELETE /identity/v3/users/e1ce45ce4783427e8ee91607e9fcc7a3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:31.638726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.641073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:31.641328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:31.769063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:31.788043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0a5a-0291-4866-a1c4-e5a91942d780 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:31.797336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:31.798260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:31.798645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:31.799047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:31.801285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:31.870851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:31.924278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 809/1629] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:31.924278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:31.928663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:31.990634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:31.991455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb6ec-e677-40e1-8187-2c67995b0ab1 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:32.018732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 821/1630] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:32.022860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.025118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.025724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.087626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:32.089089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:32.114748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 822/1631] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:32.114748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:32.120729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:32.210663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1877f8-8e17-4f8e-90c0-04f3018a8c79 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:32.227286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:32.232966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.233523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.235789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.255604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8e42-89f8-4ae4-96f1-4a46c556471a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:32.258240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:32.268190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:32.268918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.269490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:32.269633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.269633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.304471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 810/1632] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:32.304753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:32.304959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:32.305101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:32.341288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1fe04-1b94-4d33-9352-cdaa8915bca1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:32.341465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 823/1633] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:32.342127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:32.357583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:32.359982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.363873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.365047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.378710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce255-fe13-4e5f-bdd4-a21dc3ba0253 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:32.397533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:32.399920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:32.400894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.401178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.401461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] PATH_INFO: `/v3/projects/f4d641c72b5942689386edfccfb0dcbf/users/83e948ca31dc43239b4632a051b0335f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.402205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:32.449765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 811/1634] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:32.488964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d641c72b5942689386edfccfb0dcbf, user_id=83e948ca31dc43239b4632a051b0335f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:32.494988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa46f-16fe-411d-93ae-385f9eb0f17a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:32.562538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:32.576514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 824/1635] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:32 2022] PUT /identity/v3/projects/f4d641c72b5942689386edfccfb0dcbf/users/83e948ca31dc43239b4632a051b0335f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:32.610662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:32.615592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:32.615592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:32.643794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838860-fcc2-4083-91c4-0778220beed6 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:32.773383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] MFA Rules not processed for user `6820d811edde41c78884cf989347b0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:32.775720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:33.003685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.004650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.005125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.005547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.006427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:33.008603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:33.036646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 812/1636] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:33.038221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:33.064638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf55e7-dc39-4b42-b361-277e571188d3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:33.079219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.081727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.084586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.088300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] PATH_INFO: `/v3/projects/f4d641c72b5942689386edfccfb0dcbf/users/83e948ca31dc43239b4632a051b0335f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.097745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d641c72b5942689386edfccfb0dcbf, user_id=83e948ca31dc43239b4632a051b0335f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:33.109299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcf591-d956-43d5-baca-1d33e44f349e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:33.131736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 825/1637] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:33.140240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:33.145054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:33.174122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 813/1638] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:33 2022] PUT /identity/v3/projects/f4d641c72b5942689386edfccfb0dcbf/users/83e948ca31dc43239b4632a051b0335f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:33.198122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.199340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.200415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.221041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf8bbd-54f1-44f7-aaf2-7cb1f2722a4a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:33.335469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:33.381363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] MFA Rules not processed for user `83e948ca31dc43239b4632a051b0335f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:33.386135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:33.425039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:33.497999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.499163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.499674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.501595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.503944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:33.507418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:33.571407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 814/1639] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:33.589145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:33.592552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:33.658477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 826/1640] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:33 2022] POST /identity/v3/projects => generated 401 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:33.665328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:33.736265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803916c-7c7b-42fb-a6d0-cc54ba975cc3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:33.858379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670704d2-144a-4d15-b709-c641dc16ba2b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:33.871065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.871932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.873061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.875907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.876374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:33.879814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:33.905629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.906332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.908983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.909408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.945226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 827/1641] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:33 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:33.948487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:33.974419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523b79-2602-420d-8e47-021ced4eee9e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:33.992359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:33.993229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:33.993592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:33.993941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:33.994823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:33.997020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:34.014832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 828/1642] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:34.021536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:34.044772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93cb83-89dc-470c-8940-1a87d974b9a3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:34.057461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:34.059817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:34.059817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:34.062908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] PATH_INFO: `/v3/projects/0c89bbaed99544438b2cdae15a841677/users/fa6f63b10cd34627a117a564ac40e77a/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:34.116686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c89bbaed99544438b2cdae15a841677, user_id=fa6f63b10cd34627a117a564ac40e77a, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:34.124040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864923b1-ffff-434b-b565-e9ce06c44739 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:34.164342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 829/1643] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:34 2022] PUT /identity/v3/projects/0c89bbaed99544438b2cdae15a841677/users/fa6f63b10cd34627a117a564ac40e77a/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:34.164342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a6bc-bf77-4190-9375-b327fbd39f1f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:34.164342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a6bc-bf77-4190-9375-b327fbd39f1f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:34.164342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a6bc-bf77-4190-9375-b327fbd39f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:34.196575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:34.207719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:34.231304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a953a6bc-bf77-4190-9375-b327fbd39f1f None None] MFA Rules not processed for user `39d92849843e49e7833f03ca38cb8367`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:34.233117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a953a6bc-bf77-4190-9375-b327fbd39f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:34.266748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 815/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:34.270397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:34.333884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:34.342536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745120c1-81e1-4030-b007-815d8d6fd11d service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:34.441828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 830/1645] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:34.444331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:34.445114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:34.455589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:34.459948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:34.594728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] MFA Rules not processed for user `39d92849843e49e7833f03ca38cb8367`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:34.616745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:34.631550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 831/1646] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:34.679359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:34.682352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:34.736195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:34.737064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:34.737519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:34.737816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:34.738619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:34.740364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:34.773266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 816/1647] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:34.777082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:34.815199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601248c-26d7-4a6e-931f-f4a666b04b75 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:34.832865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:34.833810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:34.834096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:34.834375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] PATH_INFO: `/v3/projects/0c89bbaed99544438b2cdae15a841677/users/fa6f63b10cd34627a117a564ac40e77a/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:34.839085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c89bbaed99544438b2cdae15a841677, user_id=fa6f63b10cd34627a117a564ac40e77a, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:34.844974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:34.875827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 817/1648] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:34 2022] PUT /identity/v3/projects/0c89bbaed99544438b2cdae15a841677/users/fa6f63b10cd34627a117a564ac40e77a/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:35.060323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfede6b-fce7-4697-b3f5-0e4a4e768c98 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:35.238537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:35.239571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:35.239725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:35.244363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:35.448490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:35.448490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:35.480664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 832/1649] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:35.586059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:35.589448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:36.018845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518861-bc75-4b27-bb5b-1ef8f4779bb6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:36.028421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:36.030182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.030733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.032712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] PATH_INFO: `/v3/projects/84a495ebc66440419f2475ab298ef29a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.058017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a495ebc66440419f2475ab298ef29a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:36.062473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:36.118998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:36.140013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137a50-74c4-434d-9910-f10937a29fe0 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:36.149429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:36.150400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.150679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.150958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] PATH_INFO: `/v3/users/6cf73a8aad884c9a9345398b8a6405fc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.157998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf73a8aad884c9a9345398b8a6405fc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:36.165302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:36.245073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:36.355684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf73a8aad884c9a9345398b8a6405fc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.364881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a495ebc66440419f2475ab298ef29a', 'request_id': 'req-d593875f-c678-4f9e-bd6f-7473f555f509'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.381552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a495ebc66440419f2475ab298ef29a', 'request_id': 'req-d593875f-c678-4f9e-bd6f-7473f555f509'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.384633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf73a8aad884c9a9345398b8a6405fc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.403163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a495ebc66440419f2475ab298ef29a', 'request_id': 'req-d593875f-c678-4f9e-bd6f-7473f555f509'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.415380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf73a8aad884c9a9345398b8a6405fc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.417183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf73a8aad884c9a9345398b8a6405fc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.442820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-19f59e50-a103-4575-a4b8-dd345de2668a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf73a8aad884c9a9345398b8a6405fc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.470077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 833/1650] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:36 2022] DELETE /identity/v3/users/6cf73a8aad884c9a9345398b8a6405fc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:04:36.487058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41fd-637a-4bcb-a36d-ba010ecee969 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.487643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41fd-637a-4bcb-a36d-ba010ecee969 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.488135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a41fd-637a-4bcb-a36d-ba010ecee969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.494602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] The token cache is being invalidate because project 84a495ebc66440419f2475ab298ef29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:36.495112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.496277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d593875f-c678-4f9e-bd6f-7473f555f509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:36.507461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 818/1651] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:35 2022] DELETE /identity/v3/projects/84a495ebc66440419f2475ab298ef29a => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:36.517717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.518320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.518994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.536426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7f3a41fd-637a-4bcb-a36d-ba010ecee969 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:36.539735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7f3a41fd-637a-4bcb-a36d-ba010ecee969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:36.549434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:36.552207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:36.726831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 834/1652] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:36.738222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:36.839285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.839588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.839841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.841734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 819/1653] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:36.870663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:36.881843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:36.884198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:36.884510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:36.911897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 835/1654] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:36.912967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:36.945504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d67c3-26cd-431f-ae3e-610ad77407da None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:36.954766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:36.956099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:36.957922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:36.958348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:36.961440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:36.961912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:36.971960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.024399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 836/1655] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:37.025687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.054787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2067-e0c8-49cc-bf16-6238da3badbb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.071111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.073183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.073787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.074360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.075274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.083321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.161559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 837/1656] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:37 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:37.171196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.178072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eafc64-0be9-4de9-bc8e-38a13596507b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.341922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:37.372958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0212eb-9770-4d52-8d3f-b7d1d583d194 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.393841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.395138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.396286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.396791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.397800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.400636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ee80-c073-4c0e-8df8-1101f40c64a5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.443972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.445072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.445590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.447157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.472574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 838/1657] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:37 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:37.474625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c55d-f37c-403c-b08c-e829b0caf7a5 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.475711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.477699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c55d-f37c-403c-b08c-e829b0caf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.482475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c55d-f37c-403c-b08c-e829b0caf7a5 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.484275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ab97-9ba0-4797-808a-98dc3748d906 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.488632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 839/1658] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 6 21:04:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:37.489668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c55d-f37c-403c-b08c-e829b0caf7a5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.545021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c55d-f37c-403c-b08c-e829b0caf7a5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.545361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 820/1659] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:37.548373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.548934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.549434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.569161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.570235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.570612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.571039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.572228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.576341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.625071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 840/1660] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:37.631096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.663127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0fe7-c7cf-49b1-8af5-50f581389501 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.699076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.699803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.700116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.700455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.701895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.707737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.738331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:37.740114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:37.751092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 841/1661] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:37.757628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.760773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:37.762060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 821/1662] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:37.763043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.794331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53eae-c940-4bb5-8ffb-1bdfc777d014 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.804623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885483-91b9-4c37-a0e4-36ebca8e2c03 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:37.810159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.811474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.812040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.813295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] PATH_INFO: `/v3/projects/0a367d070eaf436988277e441b3c191a/users/2a14994f544241e1b34acb8169fde7d5/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.831746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:37.832715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:37.832997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:37.833270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] PATH_INFO: `/v3/users/ebbccef7f2ea4ddfbac2722bd2d0af24` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:37.839676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbccef7f2ea4ddfbac2722bd2d0af24)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.850036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.873053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a367d070eaf436988277e441b3c191a, user_id=2a14994f544241e1b34acb8169fde7d5, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:37.877370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:37.907072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 822/1663] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:37 2022] PUT /identity/v3/projects/0a367d070eaf436988277e441b3c191a/users/2a14994f544241e1b34acb8169fde7d5/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:37.910168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:37.974043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbccef7f2ea4ddfbac2722bd2d0af24'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:37.992154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbccef7f2ea4ddfbac2722bd2d0af24'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:38.054060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbccef7f2ea4ddfbac2722bd2d0af24'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:38.057863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbccef7f2ea4ddfbac2722bd2d0af24'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:38.089675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ce2b1bdb-a143-419f-9bc5-0811649f4b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbccef7f2ea4ddfbac2722bd2d0af24'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:38.100101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:38.108605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 842/1664] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:37 2022] DELETE /identity/v3/users/ebbccef7f2ea4ddfbac2722bd2d0af24 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:38.119158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.119454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.120541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.125173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed515-02b9-47f3-acc6-ddc141e8dd44 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:38.219343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] MFA Rules not processed for user `2a14994f544241e1b34acb8169fde7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:38.220576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:38.320773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:38.322752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.323580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.323580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.331022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:38.363440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:38.365049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21692968-d373-4090-b097-f542bd610a11 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:38.389648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 823/1665] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:38.391508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.391803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.392116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.431314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 843/1666] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:38.434736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:38.436225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:38.440975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:38.443178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:38.491073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:38.586201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 824/1667] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:38.592609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53c06-7bcf-403e-91a8-f40e886dfaa7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:38.599678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:38.600737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.601164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.601690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.602839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:38.605455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:38.664178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 844/1668] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:38 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:04:38.670420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:38.687426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4f83a-06ef-45c0-9d5b-7da39e558373 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:38.739375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:38.741575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:38.846906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:38.847673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.847898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.848824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.850679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:38.853219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:38.885098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0cf5-a9bc-4328-9b88-5cd0db6875ca admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:38.898670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:38.901791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:38.902102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:38.902384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:38.907157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 825/1669] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:38 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:38.913399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:38.980266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:38.982582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:38.991515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0416d9e-f285-4af3-9b85-c326b6241c64 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.010650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.014025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.017059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.017559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.018611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.024167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.024713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 845/1670] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:39.026679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.031015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:39.056783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 826/1671] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:39.058620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.061296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1443bb-ab2a-4613-ad54-0611beb28dc5 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.093205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.094331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.094537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.094911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] PATH_INFO: `/v3/projects/90f13837d6544b8da91f4096d004b865` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.096560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f13837d6544b8da91f4096d004b865)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.096787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaed0a-f391-4f9d-a41d-7b0e8940fe78 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.097947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: WARNING py.warnings [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:04:39.097947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: warnings.warn(msg) Jun 06 21:04:39.097947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: Jun 06 21:04:39.099765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.111871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.113307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.113711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.114800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] PATH_INFO: `/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e/users/d718d506ff774f948136a215bade8fe7/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.153632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70c6f03aac1405c8cde9ad8da385f9e, user_id=d718d506ff774f948136a215bade8fe7, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.161760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.183946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:39.222449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f13837d6544b8da91f4096d004b865', 'request_id': 'req-77cc0644-1626-40ad-8443-8bf376510149'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.224755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 827/1672] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:39 2022] PUT /identity/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e/users/d718d506ff774f948136a215bade8fe7/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:39.226566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.231925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f13837d6544b8da91f4096d004b865', 'request_id': 'req-77cc0644-1626-40ad-8443-8bf376510149'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.253396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f13837d6544b8da91f4096d004b865', 'request_id': 'req-77cc0644-1626-40ad-8443-8bf376510149'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.279100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] The token cache is being invalidate because project 90f13837d6544b8da91f4096d004b865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:39.279743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.281497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.284914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 846/1673] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:39 2022] DELETE /identity/v3/projects/90f13837d6544b8da91f4096d004b865 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:39.291516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.301874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:39.446043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:39.531243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ded81-31ad-4644-98cd-b2438dbe5541 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.542386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0644-1626-40ad-8443-8bf376510149 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.557972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.559066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.559493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.559948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.560919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.568314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f458-5a4e-42fc-93a9-f94679bd4d3d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.579396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.581412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.581922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.582388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] PATH_INFO: `/v3/users/83e948ca31dc43239b4632a051b0335f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.584426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e948ca31dc43239b4632a051b0335f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.589398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.597050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 828/1674] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:39.602759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.603615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.604136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.607445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 829/1675] 10.222.0.33 () {54 vars in 960 bytes} [Mon Jun 6 21:04:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:39.609587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.612318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:39.634540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332706e-d2d2-43f6-8c9f-c48af614fcb2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.646242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:39.648852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.649877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.651521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] PATH_INFO: `/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e/users/d718d506ff774f948136a215bade8fe7/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.657525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70c6f03aac1405c8cde9ad8da385f9e, user_id=d718d506ff774f948136a215bade8fe7, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:39.664096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ef63-87df-40ef-b212-8d4a733701d1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:39.700091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 830/1676] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:39 2022] PUT /identity/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e/users/d718d506ff774f948136a215bade8fe7/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:39.700091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.700091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.700091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.708529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e948ca31dc43239b4632a051b0335f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.717482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e948ca31dc43239b4632a051b0335f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.720963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:39.722469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:39.767629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e948ca31dc43239b4632a051b0335f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.769328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e948ca31dc43239b4632a051b0335f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.792528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3d1ada3b-1591-41bf-9b7d-a74cef40dd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e948ca31dc43239b4632a051b0335f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:39.816680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 847/1677] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:39 2022] DELETE /identity/v3/users/83e948ca31dc43239b4632a051b0335f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:39.818499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:39.836251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:39.836831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:39.880851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 831/1678] 10.222.0.33 () {58 vars in 1057 bytes} [Mon Jun 6 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:39.892997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:39.919594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] MFA Rules not processed for user `d718d506ff774f948136a215bade8fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:39.920585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f5dda-fae4-4542-9ac1-65e8bfd71fbe None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:39.921587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.114398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 848/1679] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:40.145837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:40.148108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.158092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:40.159251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:40.159808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:40.160385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:40.163112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.188389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:40.190653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:40.224043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 832/1680] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:40.248893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:40.316521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f4fb9-9e10-4d48-9af0-9022c4feef24 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:40.327420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:40.328693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:40.329056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:40.329264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:40.346780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:40.348557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:40.383689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 849/1681] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:40.737209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:40.742924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.770264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04efdf-4ed5-4b52-8ef1-895c72babcc0 service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:40.817655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:40.817943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:40.818368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:40.818368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:40.818368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:40.823269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.846605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:40.881517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:41.125406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412600c5-4fdf-4cd7-8b98-5fda68435ead service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:41.142045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:41.143024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:41.143316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:41.143599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] PATH_INFO: `/v3/projects/f4d641c72b5942689386edfccfb0dcbf` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:41.149599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d641c72b5942689386edfccfb0dcbf)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:41.153563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:41.154562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:41.155161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134b3e8-cbcd-4eac-8d32-26c2716e7d30 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:41.186214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 833/1682] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:41.268358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d641c72b5942689386edfccfb0dcbf', 'request_id': 'req-912f2be1-7641-44e2-afaf-500d3e774660'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:41.277579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d641c72b5942689386edfccfb0dcbf', 'request_id': 'req-912f2be1-7641-44e2-afaf-500d3e774660'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:41.289669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d641c72b5942689386edfccfb0dcbf', 'request_id': 'req-912f2be1-7641-44e2-afaf-500d3e774660'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:41.335487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] The token cache is being invalidate because project f4d641c72b5942689386edfccfb0dcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:41.338038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:41.341196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-912f2be1-7641-44e2-afaf-500d3e774660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:41.348490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 850/1683] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:40 2022] DELETE /identity/v3/projects/f4d641c72b5942689386edfccfb0dcbf => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:41.355736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:41.356128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:41.356329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:41.413217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:41.414609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:41.642263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 834/1684] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:41.659499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:41.661859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:41.662580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:41.736139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:41.742565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:41.776949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 851/1685] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:41.782636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:41.802524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe73ba-68a4-4575-8d5c-f3e336f99852 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:41.832787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:41.833512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:41.837582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:41.837883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:41.838705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:41.839027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:41.847904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:41.903168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 835/1686] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:41.905785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:41.964350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5411-5013-4f83-8f99-a07f0e8d2f3a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:41.992679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:41.997034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:41.997034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:42.000756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:42.004271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:42.012892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc61d0-a531-4ff5-b975-e09b54a01bda admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:42.258632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 852/1687] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:41 2022] POST /identity/v3/projects => generated 357 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:42.266671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:42.289702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:42.290210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:42.290676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:42.332645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1d90-a2b1-460f-8582-e58afa8818ab admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:42.462708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] MFA Rules not processed for user `fa6f63b10cd34627a117a564ac40e77a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:42.464703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:42.697257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:42.799520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:42.803428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:42.804539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:42.805263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:42.807064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:42.816730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:42.915772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 836/1688] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:42 2022] POST /identity/v3/users => generated 279 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:42.918605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:42.931588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:42.981270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 853/1689] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 690 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:42.995568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:43.004715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d9d2-e2a6-45c5-a6e8-9d0bf0bba374 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:43.033340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:43.033340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:43.033340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:43.033340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] PATH_INFO: `/v3/projects/c1a4dae8c2004be29cd9abd52fac2269` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:43.040910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a4dae8c2004be29cd9abd52fac2269)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:43.061272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7c16-ace8-4c5e-b447-5bfd77f6d0c2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:43.062306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:43.091956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:43.096367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:43.098099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:43.098703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:43.099773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:43.101954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:43.139478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:43.145214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 854/1690] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:43.146247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:43.236969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e7c1-9ad2-4470-935b-1f6b492d05f7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:43.279261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a4dae8c2004be29cd9abd52fac2269', 'request_id': 'req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:43.298122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a4dae8c2004be29cd9abd52fac2269', 'request_id': 'req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:43.316681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a4dae8c2004be29cd9abd52fac2269', 'request_id': 'req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:43.390738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] The token cache is being invalidate because project c1a4dae8c2004be29cd9abd52fac2269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:43.399397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:43.405802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62253a9c-cdcb-4e09-94c6-f6b96bc0de70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:43.440483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 837/1691] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:42 2022] DELETE /identity/v3/projects/c1a4dae8c2004be29cd9abd52fac2269 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:43.449326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8efc5-a926-4152-9855-790e986c9122 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:43.452997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8efc5-a926-4152-9855-790e986c9122 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:43.453774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8efc5-a926-4152-9855-790e986c9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:43.581219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-70a8efc5-a926-4152-9855-790e986c9122 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:43.588783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-70a8efc5-a926-4152-9855-790e986c9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:43.710648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:43.719548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:43.720439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:43.720678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:43.721985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:43.725008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:43.814691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 855/1692] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 665 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:43.817047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:43.831144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:43.890367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a48000-d816-4189-a03e-bf2b7be68304 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:43.913568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:43.915091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:43.915504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:43.916946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] PATH_INFO: `/v3/projects/7699d31d2c494ae2b10835d7f95d17e5/users/0f3c3ef050044c04bab6700221920b4c/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:43.995693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 838/1693] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:44.003185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.003709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.004244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.007468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7699d31d2c494ae2b10835d7f95d17e5, user_id=0f3c3ef050044c04bab6700221920b4c, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:44.011783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b0813-d52d-4ec3-af93-e93cc118aafc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:44.109517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 856/1694] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:43 2022] PUT /identity/v3/projects/7699d31d2c494ae2b10835d7f95d17e5/users/0f3c3ef050044c04bab6700221920b4c/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:44.114189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:44.116307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:44.126663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.127178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.127676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.292219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] MFA Rules not processed for user `0f3c3ef050044c04bab6700221920b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:44.299613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:44.423613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 839/1695] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:44.429010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:44.451275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f650-0c8d-4d50-88c6-7259a8c7bbc9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:44.465107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:44.468516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.468787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.469370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.472182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:44.472604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:44.476208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:44.510623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 857/1696] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:44.519179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:44.524417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 840/1697] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:44.531043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:44.554401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d33a13-7570-4727-be91-ad37d2c36812 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:44.567821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5beeec-f40d-4a3c-9f39-1f151da62a53 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:44.572152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:44.573297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.573791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.574306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.575251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:44.578144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:44.584107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:44.584900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.585201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.585538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.586335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:44.590735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:44.603639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:44.625041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 858/1698] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:44.633829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:44.696443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 841/1699] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:04:44.698315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:44.792500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7d4e-aca3-43b3-9a9e-f71355091f50 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:44.794873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:44.961593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:44.963696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:44.966463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:44.967081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:44.969339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:44.973066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:44.984265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aff69-9fd0-4dd1-8410-d47708ed5db7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:44.997853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.004954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.006304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.006994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.010209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.013367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.044043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 859/1700] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/users => generated 284 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:45.047821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.096237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 842/1701] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:44 2022] POST /identity/v3/users => generated 303 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:45.097100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.103362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c496-58e4-4e4f-acda-7dfb63ca1677 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.138545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.141057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460f490-8f17-437d-83ba-7d31ec1caaa6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.144799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.146087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.150089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.152980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.153839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.156994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.157668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.158304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.158523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.163544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.166558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.202033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 843/1702] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:45.206019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.232033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4194-9869-42d4-bb31-e39089c816a4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.250392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.254384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.254384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.254384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.254890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.255116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 860/1703] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:45.257527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.260859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.289916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 844/1704] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:45.299159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.324350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865cb5-0231-4d04-ae86-05eb6a608238 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.335041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c87c-5d90-481b-a07a-12aec1f267dc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.341811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.342963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.343314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.343658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] PATH_INFO: `/v3/projects/3e9b4b6947e848f4a9333d94e97801e9/users/3465c8ef383e48b2acefb48f40b1dff5/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.360048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.362478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.363005 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.363475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] PATH_INFO: `/v3/projects/e6f5082f8c9b484c934b6d2d49394a59/users/07ead170b426407b9de9f4af75ba521f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.365047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9b4b6947e848f4a9333d94e97801e9, user_id=3465c8ef383e48b2acefb48f40b1dff5, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.369181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a25ec2-a4ce-45e0-884c-fc60e84c6011 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.396650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 845/1705] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:45 2022] PUT /identity/v3/projects/3e9b4b6947e848f4a9333d94e97801e9/users/3465c8ef383e48b2acefb48f40b1dff5/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:45.408854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad0ae-21be-46fd-9cc6-5a778059706e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.409356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad0ae-21be-46fd-9cc6-5a778059706e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.409837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad0ae-21be-46fd-9cc6-5a778059706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.422823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f5082f8c9b484c934b6d2d49394a59, user_id=07ead170b426407b9de9f4af75ba521f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.431271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.495255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 861/1706] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:45 2022] PUT /identity/v3/projects/e6f5082f8c9b484c934b6d2d49394a59/users/07ead170b426407b9de9f4af75ba521f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:45.502027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.538237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-932ad0ae-21be-46fd-9cc6-5a778059706e None None] MFA Rules not processed for user `3465c8ef383e48b2acefb48f40b1dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:45.542482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-932ad0ae-21be-46fd-9cc6-5a778059706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:45.663963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:45.674668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c1b4-cea9-4b4e-a7ab-26382232bf6b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.686687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.687756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.688134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.688475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.689262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.690953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.712507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 862/1707] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:45.714027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.716443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:45.743940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4d99-5d21-4033-be2b-50ed9a9cec2e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.760287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.760287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.760287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.760287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] PATH_INFO: `/v3/users/2a14994f544241e1b34acb8169fde7d5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.760861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 846/1708] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:45.761136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a14994f544241e1b34acb8169fde7d5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.762459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.762774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.763829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.766117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:45.786674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:45.788126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:45.868252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a14994f544241e1b34acb8169fde7d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:45.896475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a14994f544241e1b34acb8169fde7d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:45.922304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:45.951718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 847/1709] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:45.953053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:45.968063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754e78-da67-48f7-bcb8-1c4be2163589 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:45.973970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:45.975580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:45.975885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:45.983730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] PATH_INFO: `/v3/projects/e6f5082f8c9b484c934b6d2d49394a59/users/07ead170b426407b9de9f4af75ba521f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:45.985290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a14994f544241e1b34acb8169fde7d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:45.987508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f5082f8c9b484c934b6d2d49394a59, user_id=07ead170b426407b9de9f4af75ba521f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:45.988065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a14994f544241e1b34acb8169fde7d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:45.991442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.009562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 848/1710] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:45 2022] PUT /identity/v3/projects/e6f5082f8c9b484c934b6d2d49394a59/users/07ead170b426407b9de9f4af75ba521f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:46.012243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.015308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.044808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3ab4eda6-081d-4015-b390-432617bf9a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a14994f544241e1b34acb8169fde7d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.102650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 863/1711] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:45 2022] DELETE /identity/v3/users/2a14994f544241e1b34acb8169fde7d5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:46.110492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7a76-07fb-4447-89d5-055f975369e0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.124844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7a76-07fb-4447-89d5-055f975369e0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.126773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7a76-07fb-4447-89d5-055f975369e0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.134702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2cd-8f96-4931-a091-7df44d718673 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:46.146025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 864/1712] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:04:46 2022] GET /identity => generated 270 bytes in 37 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:04:46.149150 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.155593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.166209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.216870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:46.217615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.217983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.218270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.219015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:46.223671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec95e-25f9-4957-ab2f-d23908a2060d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.252917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] MFA Rules not processed for user `07ead170b426407b9de9f4af75ba521f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:46.255678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.270541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 849/1713] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:46 2022] POST /identity/v3/projects => generated 405 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:46.270541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e9dd-c5cc-4433-b89a-bbddf7d66db5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.270851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e9dd-c5cc-4433-b89a-bbddf7d66db5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.271321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e9dd-c5cc-4433-b89a-bbddf7d66db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.297733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-10d3e9dd-c5cc-4433-b89a-bbddf7d66db5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:46.299198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-10d3e9dd-c5cc-4433-b89a-bbddf7d66db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.389390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 850/1714] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:46.391027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.391345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.391770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.415902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:46.418083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.431021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:46.477554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 865/1715] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:46.480213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.482993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.515191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800175-88da-4342-805f-8cf92c7fff18 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:46.525402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:46.526855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.527345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.527810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] PATH_INFO: `/v3/users/2d979de65f3a4cc48a1f1c9d6c803638` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.530215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d979de65f3a4cc48a1f1c9d6c803638)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:46.533719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.593111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 851/1716] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:46.594175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.608803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3495207-9275-40a3-b446-5f5de0d0494d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:46.616557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:46.617554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.618139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.618566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.619391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:46.624474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.637594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:46.644340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d979de65f3a4cc48a1f1c9d6c803638'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.664994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 852/1717] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:46 2022] POST /identity/v3/users => generated 309 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:46.669812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.671784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d979de65f3a4cc48a1f1c9d6c803638'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.672855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.697741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d979de65f3a4cc48a1f1c9d6c803638'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.699373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d979de65f3a4cc48a1f1c9d6c803638'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.712211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d979de65f3a4cc48a1f1c9d6c803638'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:46.722699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 866/1718] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:46 2022] DELETE /identity/v3/users/2d979de65f3a4cc48a1f1c9d6c803638 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:46.725417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.728469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.787929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec1ae-02e4-4f12-8f6d-8cba7269bf80 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:46.814419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3181a7-c64b-4e72-aa87-caca90ea5543 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:46.825887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:46.826712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.827001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.827811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.829841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.887781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:46.888530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:46.888798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:46.889066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:46.891832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.923383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:46.925883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.939911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 867/1719] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:46.940397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:46.941891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:46.942104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:46.981964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:46.984320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:46.995713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 853/1720] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:04:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:04:46.997163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.000971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:47.050019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac082f2-dfdb-4500-82e0-8fd975da7546 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.056904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.057619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.058115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.058423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.061329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:47.157081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:47.244746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569123f5-10b5-463a-9486-2abd5e6ee39c service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.266151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.266864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.269248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.269248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.272529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:47.308285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.310848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.337194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.345120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b7f91-a866-460e-a86e-2c5ef88c7686 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.347284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 854/1721] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:47.348739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.353888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:47.391688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304395-086b-44db-93b8-42d3520962a0 service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.400943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.402051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.402492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.402930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.404096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.409879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 868/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:47.412064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.415981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.416453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.418119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.432359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 855/1723] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:47.437707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.463427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08975-3780-4ff1-84ec-8afc487e49f1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.500995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:47.501308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.504708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.504982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.505273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] PATH_INFO: `/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee/users/765b8810e58242d287cec5494e5f0f37/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.509795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:47.557474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 869/1724] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:47.582054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba8bd90c9b4b6faa74cf1d4a3924ee, user_id=765b8810e58242d287cec5494e5f0f37, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.594257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.600148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.640298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137c5af-0712-4b2a-8318-93af7a9a59d1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.665405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 856/1725] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:47 2022] PUT /identity/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee/users/765b8810e58242d287cec5494e5f0f37/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:47.674060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.674385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.674385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.674385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.674385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.735109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.743858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.792400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25bc45-07f0-4f6c-87d8-8b0c64c7ab81 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.800328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 870/1726] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:47.801663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.803436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.804567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.804781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.805068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.806003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.809743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.826541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 857/1727] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:47.832630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:47.844451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb17c-fcf7-4139-b8a4-6e58b4120d75 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.848692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec0fc-98a0-4eb0-8a3d-3ab1ac62ffb3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:47.857575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:47.859036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.859252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.859752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] PATH_INFO: `/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee/users/765b8810e58242d287cec5494e5f0f37/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.863044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba8bd90c9b4b6faa74cf1d4a3924ee, user_id=765b8810e58242d287cec5494e5f0f37, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:47.871080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fb8fb-1f3b-4cd0-b56d-5b25ce155ce6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:47.911420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 858/1728] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:47 2022] PUT /identity/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee/users/765b8810e58242d287cec5494e5f0f37/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:47.915325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:47.915713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:47.916030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:47.955826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:47.988628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] MFA Rules not processed for user `765b8810e58242d287cec5494e5f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:47.996747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:48.043452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:48.055295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:48.056039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:48.056265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:48.065389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:48.227128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 859/1729] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:48.245090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:48.248593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:48.291501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:48.293772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:48.319121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 871/1730] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:47 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:48.375828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:48.377646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:48.415102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b43bd-7f85-4720-bb51-9607118f60fb service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:48.415343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9deae-63bd-452d-8b42-b5ea6e5d976c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:48.423365 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:48.424426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:48.425321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:48.426102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:48.459720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:48.466748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:48.513507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 860/1731] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:48.724553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:48.728630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:48.790513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:48.829078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:48.839755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:48.840256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:48.840683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] PATH_INFO: `/v3/users/6820d811edde41c78884cf989347b0f4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:48.853126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6820d811edde41c78884cf989347b0f4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:48.855223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:49.085428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc457857-a2bd-44e2-87d1-0cadc9af0ec4 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:49.110656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6820d811edde41c78884cf989347b0f4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.115888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:49.121148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:49.123253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:49.126592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] PATH_INFO: `/v3/projects/0a367d070eaf436988277e441b3c191a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:49.134971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a367d070eaf436988277e441b3c191a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:49.152972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:49.162301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6820d811edde41c78884cf989347b0f4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.243572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6820d811edde41c78884cf989347b0f4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.246965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6820d811edde41c78884cf989347b0f4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.274323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6820d811edde41c78884cf989347b0f4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.285592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 872/1732] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:48 2022] DELETE /identity/v3/users/6820d811edde41c78884cf989347b0f4 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:49.287854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:49.291381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:49.376624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:49.395985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a367d070eaf436988277e441b3c191a', 'request_id': 'req-9dc15838-06d8-4c19-8271-b4bbca19252e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.417524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a367d070eaf436988277e441b3c191a', 'request_id': 'req-9dc15838-06d8-4c19-8271-b4bbca19252e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.457111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a367d070eaf436988277e441b3c191a', 'request_id': 'req-9dc15838-06d8-4c19-8271-b4bbca19252e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.494478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] The token cache is being invalidate because project 0a367d070eaf436988277e441b3c191a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:49.494699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c129c06-b08c-48b9-9e02-e12a9cbb9a6a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:49.495019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.496041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9dc15838-06d8-4c19-8271-b4bbca19252e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.506157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 861/1733] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:48 2022] DELETE /identity/v3/projects/0a367d070eaf436988277e441b3c191a => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:49.507807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79144d4-a01e-44b6-a9e1-111a1b668a01 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:49.508148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79144d4-a01e-44b6-a9e1-111a1b668a01 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:49.508621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79144d4-a01e-44b6-a9e1-111a1b668a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:49.590328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e79144d4-a01e-44b6-a9e1-111a1b668a01 None None] MFA Rules not processed for user `8713cb23a93147f8b52f88e240c81d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:49.592419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e79144d4-a01e-44b6-a9e1-111a1b668a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:49.603561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:49.605142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:49.605949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:49.606455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] PATH_INFO: `/v3/users/3465c8ef383e48b2acefb48f40b1dff5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:49.609386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3465c8ef383e48b2acefb48f40b1dff5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:49.616596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:49.696383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:49.804710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3465c8ef383e48b2acefb48f40b1dff5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.828184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3465c8ef383e48b2acefb48f40b1dff5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.867053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3465c8ef383e48b2acefb48f40b1dff5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.869282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3465c8ef383e48b2acefb48f40b1dff5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.891938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3465c8ef383e48b2acefb48f40b1dff5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:49.967140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 873/1734] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:49 2022] DELETE /identity/v3/users/3465c8ef383e48b2acefb48f40b1dff5 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:49.972435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:49.983594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:50.038281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 862/1735] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:50.038281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:50.038574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:50.038875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:50.138041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:50.152035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:50.349585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa032c-dc50-4194-9eea-02fbdf799186 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:50.366672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:50.368614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:50.368910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:50.369196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] PATH_INFO: `/v3/users/d718d506ff774f948136a215bade8fe7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:50.377628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d718d506ff774f948136a215bade8fe7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:50.379854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:50.511738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 863/1736] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:50.513016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:50.533480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:50.551334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd718d506ff774f948136a215bade8fe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:50.580913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd718d506ff774f948136a215bade8fe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:50.634162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd718d506ff774f948136a215bade8fe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:50.634986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd718d506ff774f948136a215bade8fe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:50.656327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd718d506ff774f948136a215bade8fe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:50.674197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 874/1737] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:49 2022] DELETE /identity/v3/users/d718d506ff774f948136a215bade8fe7 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:50.767741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:50.789394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:50.791644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:50.811967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93889f1b-d22b-4ab8-a547-41e9117bd0cf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:50.861488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:51.021572 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:51.022750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:51.023210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:51.023536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:51.036169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:51.085836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44105135-d4f5-4586-b7c3-25f0a6b259e1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:51.105365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:51.109747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:51.110076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:51.115268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:51.129290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:51.269346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:51.271815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:51.306183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 864/1738] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:51.307444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:51.317431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:51.463547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:51.473626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab0c4f-b390-4d7b-92cf-8faedc985418 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:51.513661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 875/1739] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:04:51.515464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:51.515689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:51.515960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:51.583146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e810f60-d4d5-4b01-8f06-c2f35dfb6d39 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:51.617548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:51.619121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:51.634225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:51.645068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:51.645468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:51.648608 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] PATH_INFO: `/v3/projects/522b8c683a104408805d7f7b39aff791` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:51.649919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 876/1740] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jun 6 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:51.654013 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522b8c683a104408805d7f7b39aff791)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:51.662556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:51.680159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:51.681793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:51.705783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e0969-ee54-4c55-a60b-03d441c9d212 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:51.757002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:51.758001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:51.758320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:51.758608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:51.784214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:51.786274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:51.823641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 877/1741] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:04:51.935665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:51.990849 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522b8c683a104408805d7f7b39aff791', 'request_id': 'req-3a69cd6e-3204-441f-a043-51fb01a43b39'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.068283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522b8c683a104408805d7f7b39aff791', 'request_id': 'req-3a69cd6e-3204-441f-a043-51fb01a43b39'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.109516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522b8c683a104408805d7f7b39aff791', 'request_id': 'req-3a69cd6e-3204-441f-a043-51fb01a43b39'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.167885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] The token cache is being invalidate because project 522b8c683a104408805d7f7b39aff791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:52.169872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.172574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.183356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 865/1742] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:51 2022] DELETE /identity/v3/projects/522b8c683a104408805d7f7b39aff791 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:52.185153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:52.286967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2cd08-574c-41a9-b873-fe90257b276c service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:52.319183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:52.322494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:52.557661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:52.561400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:52.566968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:52.568277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] PATH_INFO: `/v3/users/fa6f63b10cd34627a117a564ac40e77a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:52.576562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6f63b10cd34627a117a564ac40e77a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:52.592688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:52.739693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69cd6e-3204-441f-a043-51fb01a43b39 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:52.746409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:52.747619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:52.747619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:52.747979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] PATH_INFO: `/v3/projects/26d748716671444a9c507a0528faadd0` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:52.750397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d748716671444a9c507a0528faadd0)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:52.753078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:52.848178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6f63b10cd34627a117a564ac40e77a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.883048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d748716671444a9c507a0528faadd0', 'request_id': 'req-14a3023e-5523-4fda-af41-12012f980958'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.898221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:52.904468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d748716671444a9c507a0528faadd0', 'request_id': 'req-14a3023e-5523-4fda-af41-12012f980958'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.913912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6f63b10cd34627a117a564ac40e77a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.939176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d748716671444a9c507a0528faadd0', 'request_id': 'req-14a3023e-5523-4fda-af41-12012f980958'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.975681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] The token cache is being invalidate because project 26d748716671444a9c507a0528faadd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:52.977176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.980154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-14a3023e-5523-4fda-af41-12012f980958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:52.987428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 866/1743] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:52 2022] DELETE /identity/v3/projects/26d748716671444a9c507a0528faadd0 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:52.994077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:52.995377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:52.996044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:53.087614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:53.087614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:53.088851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6f63b10cd34627a117a564ac40e77a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:53.088851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6f63b10cd34627a117a564ac40e77a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:53.149426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-820c4294-8801-47c1-901b-ddd030c5c0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6f63b10cd34627a117a564ac40e77a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:53.219689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 878/1744] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:52 2022] DELETE /identity/v3/users/fa6f63b10cd34627a117a564ac40e77a => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:04:53.252932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:53.304596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 867/1745] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:04:53.317819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:53.318353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:53.318857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:53.450135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:53.460657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:53.860425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 879/1746] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:53.862453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:53.893700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27dc0e-5bf4-4ae5-bf25-841988c9d8bc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:53.917951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:53.919252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:53.919736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:53.920257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:53.923298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:04:53.924715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:53.944289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:54.004924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 868/1747] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:04:54.010105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:54.069090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780c2de-f08c-48b7-a372-ea05e9c571bd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:54.091192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:54.097678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:54.100130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:54.102470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:54.107847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:54.125015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:54.298816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 880/1748] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:54 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:54.306866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:54.391553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c2dd-0b78-4952-9153-cadfcd876fa1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:55.000592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:55.002956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:55.003649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:55.004347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:55.005820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:55.016948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:55.090977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 869/1749] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:54 2022] POST /identity/v3/users => generated 291 bytes in 786 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:55.099804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:55.214014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e01fe-c609-4841-9528-4a6fba20f417 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:55.224174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:55.225761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:55.227506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:55.228315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:55.231114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:55.237541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:55.296059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 881/1750] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:55.302843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:55.371433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1ea08-0e2b-4220-9a28-5353a3b32a4b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:55.405456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:55.406839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:55.407321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:55.407789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:55.439071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:55.454148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6a95-da34-4133-b407-aab1f5ddb278 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:55.536823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:55.538768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 870/1751] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:04:55.601755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b001a8-384c-411f-8a03-45048348e50e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:55.632275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:55.635046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:55.635501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:55.635945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] PATH_INFO: `/v3/projects/1c0db83101ae45ab94b6d0c9ccecd5e0/users/984460544f4649f79f564832915bc2d4/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:55.734050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0db83101ae45ab94b6d0c9ccecd5e0, user_id=984460544f4649f79f564832915bc2d4, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:55.756655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:55.851438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 882/1752] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:55 2022] PUT /identity/v3/projects/1c0db83101ae45ab94b6d0c9ccecd5e0/users/984460544f4649f79f564832915bc2d4/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:55.860417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:55.862604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:55.863403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:56.076984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] MFA Rules not processed for user `984460544f4649f79f564832915bc2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:56.078328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:56.351276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 871/1753] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:56.358351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:56.685041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256a3f-9e95-49ed-aca3-f249add9346b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:56.711617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:56.712591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:56.712945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:56.712945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:56.713612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:56.715588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:56.810164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:56.846952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 883/1754] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:04:56 2022] POST /identity/v3/projects => generated 379 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:56.853255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:56.881158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd932-412b-4aaf-9733-afd0ae28b04e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:57.111619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:57.164922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:57.165916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:57.166204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:57.166482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:57.167242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:57.169409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:57.208637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 872/1755] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:04:56 2022] POST /identity/v3/users => generated 296 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:04:57.213943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:57.230835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a54dd-3484-4f12-9f7e-cc6d2efe371a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:57.248879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:57.249644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:57.249943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:57.250214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:57.251131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:57.253173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:57.283668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 884/1756] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:57.289212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:57.305640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e3df-6099-4277-a716-bb7326b621db admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:57.325774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:57.327737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:57.328097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:57.328429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] PATH_INFO: `/v3/projects/92c286db330f433e8649b7de9ce56ac0/users/a6ffed09fc35433a8814fc38da933f7d/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:57.383157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c286db330f433e8649b7de9ce56ac0, user_id=a6ffed09fc35433a8814fc38da933f7d, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:57.387819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:57.444744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 873/1757] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:57 2022] PUT /identity/v3/projects/92c286db330f433e8649b7de9ce56ac0/users/a6ffed09fc35433a8814fc38da933f7d/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:04:57.446646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:57.461520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd9686-ca4f-4fa7-8109-7f42932e776a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:57.774347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:57.775546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:57.776069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:57.776563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:57.778264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:57.787529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:57.845462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 885/1758] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:04:57.852090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:57.929308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b3f6-8119-43ca-a94a-a02ba0397990 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:57.954276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:57.962415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:57.963199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:57.963860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] PATH_INFO: `/v3/projects/92c286db330f433e8649b7de9ce56ac0/users/a6ffed09fc35433a8814fc38da933f7d/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:57.975268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c286db330f433e8649b7de9ce56ac0, user_id=a6ffed09fc35433a8814fc38da933f7d, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:57.997573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad49cd-9d91-46b4-ab22-15678cf3a231 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:58.040059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:58.043069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:58.135365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65770c-ec5e-4ff8-95de-1d3135b9845c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:58.136083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 874/1759] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:04:57 2022] PUT /identity/v3/projects/92c286db330f433e8649b7de9ce56ac0/users/a6ffed09fc35433a8814fc38da933f7d/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:58.160065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:58.160652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:58.161219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:58.390401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] MFA Rules not processed for user `a6ffed09fc35433a8814fc38da933f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:58.401267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:58.528603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:58.530536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:58.531727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:58.533932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] PATH_INFO: `/v3/projects/3e9b4b6947e848f4a9333d94e97801e9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:58.538938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9b4b6947e848f4a9333d94e97801e9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:58.543494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:58.683981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9b4b6947e848f4a9333d94e97801e9', 'request_id': 'req-e35a70d0-b550-4ae8-bebe-304281d740f6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:58.699214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9b4b6947e848f4a9333d94e97801e9', 'request_id': 'req-e35a70d0-b550-4ae8-bebe-304281d740f6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:58.715641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9b4b6947e848f4a9333d94e97801e9', 'request_id': 'req-e35a70d0-b550-4ae8-bebe-304281d740f6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:58.747634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] The token cache is being invalidate because project 3e9b4b6947e848f4a9333d94e97801e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:58.749594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:58.756199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:58.760104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 886/1760] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:58 2022] DELETE /identity/v3/projects/3e9b4b6947e848f4a9333d94e97801e9 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:04:58.764397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:58.768407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:58.817981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:58.934240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a70d0-b550-4ae8-bebe-304281d740f6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:58.961307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:58.962372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:58.962661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:58.962944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] PATH_INFO: `/v3/users/765b8810e58242d287cec5494e5f0f37` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:58.964646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765b8810e58242d287cec5494e5f0f37)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:58.971226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:59.062227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 875/1761] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 904 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:04:59.063923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:59.069978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:59.084597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765b8810e58242d287cec5494e5f0f37'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.105079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765b8810e58242d287cec5494e5f0f37'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.107148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5773b5-504a-415b-8f52-1e78a270a078 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:59.128802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:59.135545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:59.136476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765b8810e58242d287cec5494e5f0f37'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.137109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:59.137600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765b8810e58242d287cec5494e5f0f37'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.137928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] PATH_INFO: `/v3/projects/0c89bbaed99544438b2cdae15a841677` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:59.147914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c89bbaed99544438b2cdae15a841677)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:59.153936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765b8810e58242d287cec5494e5f0f37'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.156492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:59.167451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 887/1762] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:04:58 2022] DELETE /identity/v3/users/765b8810e58242d287cec5494e5f0f37 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:59.167451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:59.167451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:59.281549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c89bbaed99544438b2cdae15a841677', 'request_id': 'req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.298447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c89bbaed99544438b2cdae15a841677', 'request_id': 'req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.316149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c89bbaed99544438b2cdae15a841677', 'request_id': 'req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.326677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa72bf-288c-43f4-97e6-9e7f14588220 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:59.344904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] The token cache is being invalidate because project 0c89bbaed99544438b2cdae15a841677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:59.345583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.355303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.358049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 876/1763] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:59 2022] DELETE /identity/v3/projects/0c89bbaed99544438b2cdae15a841677 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:59.359380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:04:59.361345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:59.411632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:59.435283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:59.486953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:59.488888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:59.489179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:59.489464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] PATH_INFO: `/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:59.492817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70c6f03aac1405c8cde9ad8da385f9e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:59.494883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:04:59.558646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc627cf-1aba-4273-9ada-0cf5e7dbfa85 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:04:59.583364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:04:59.584601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:59.585123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:59.585810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:59.593018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:59.626477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70c6f03aac1405c8cde9ad8da385f9e', 'request_id': 'req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.646190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70c6f03aac1405c8cde9ad8da385f9e', 'request_id': 'req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.661169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70c6f03aac1405c8cde9ad8da385f9e', 'request_id': 'req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.690409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] The token cache is being invalidate because project b70c6f03aac1405c8cde9ad8da385f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:04:59.690752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.692029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cecd8359-7534-4a5d-8ba8-73b07aa3b6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:04:59.693197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 888/1764] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:04:59 2022] DELETE /identity/v3/projects/b70c6f03aac1405c8cde9ad8da385f9e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:04:59.701586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154793-1742-4253-baad-1c9c40da2cee None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:04:59.701917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154793-1742-4253-baad-1c9c40da2cee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:04:59.702197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154793-1742-4253-baad-1c9c40da2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:04:59.765686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7f154793-1742-4253-baad-1c9c40da2cee None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:04:59.767203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7f154793-1742-4253-baad-1c9c40da2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:04:59.982527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:04:59.989499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41c32-aae8-41bc-9625-2e697b70086b service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 889/1765] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041897d-7caf-433f-9506-3224b2b67b77 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041897d-7caf-433f-9506-3224b2b67b77 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041897d-7caf-433f-9506-3224b2b67b77 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 890/1766] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee796-6035-43f9-837c-b64e6d7ae157 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.026147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee796-6035-43f9-837c-b64e6d7ae157 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.026993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee796-6035-43f9-837c-b64e6d7ae157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.031969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 877/1767] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:00.034854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725feb4a-e70f-4b3f-b27f-3ae5a89f4537 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.064934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725feb4a-e70f-4b3f-b27f-3ae5a89f4537 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.065722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725feb4a-e70f-4b3f-b27f-3ae5a89f4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.091353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-dd9ee796-6035-43f9-837c-b64e6d7ae157 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:00.092696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dd9ee796-6035-43f9-837c-b64e6d7ae157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.134743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-725feb4a-e70f-4b3f-b27f-3ae5a89f4537 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:00.137207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 891/1768] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:00.138608 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-725feb4a-e70f-4b3f-b27f-3ae5a89f4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.140225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.140225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.140225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.160402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 878/1769] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:00.164450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.165371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.166155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.217643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:00.218628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.230693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:00.233874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.255104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 879/1770] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:00.257096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:00.326187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299f0b-c6cc-451a-ac00-1b2a14bdd9d7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:00.352628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:00.355213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.357374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.357966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.360446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:00.361414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:00.377691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:00.455579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 880/1771] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:00.458303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:00.460018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:00.504532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 892/1772] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:00.507523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:00.512278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.513960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ee5-5ddc-41a1-8492-4e7d01d8c34d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:00.539323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:00.540558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.541195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.541705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.543217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:00.544091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:00.560807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:00.627488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 881/1773] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:00.632491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:00.677680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e8186-44b4-494e-8d0d-0055b16ec56f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:00.699016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:00.700319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.700872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.701419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.703010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:00.703625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ae24-8225-4993-83b2-746da3a288d9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:00.707323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:00.716195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:00.717014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:00.717458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:00.717965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:00.727400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:00.915682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 882/1774] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:00 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:00.915682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:00.926069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:01.021863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:01.024958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:01.129322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 893/1775] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:01.131008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:01.201105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984b13-c800-4380-9836-c4fd185f1caa service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:01.380426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:01.461190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d160-4c0b-41b9-9e07-8757914deddd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:01.480718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:01.486763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:01.487201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:01.487401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:01.520053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:01.525345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:01.559751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 883/1776] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:01.561495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:01.562624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:01.563063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:01.563452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:01.565072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:01.568292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:01.586075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:01.635917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49d08-e8dc-4a6c-bcaf-7152741efd15 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:01.662971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:01.662971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:01.662971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:01.662971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:01.663798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:01.675682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:01.754536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 884/1777] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:01 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:01.756689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:01.758767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 894/1778] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:01 2022] POST /identity/v3/projects => generated 385 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:01.765696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:01.817200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320efd8b-77e4-4b72-97a6-cf49a46388cb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:01.894131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:01.972658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:01.973359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:01.973641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:01.974095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:01.975029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:01.976966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.004854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 885/1779] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:02.006136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.009107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978ed1-85ff-4a21-8bec-864cb66834ed admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.042344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.043924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.048228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.048228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.048228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.054922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.055134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0243d-a322-4680-9d05-0004fad0b3c4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.061766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.062796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.063243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.063688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.066913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.069553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.096837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 886/1780] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:02.102639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.131063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74587a-5505-4ac5-b789-a9948ca0ac2b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.137363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.138773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.139380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.139832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] PATH_INFO: `/v3/projects/f14653756c4c4827a50573696e5468b3/users/511d2955283f40c5b251366929e9ef75/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.183334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14653756c4c4827a50573696e5468b3, user_id=511d2955283f40c5b251366929e9ef75, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.183841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 895/1781] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:01 2022] POST /identity/v3/users => generated 293 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:02.186999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43df04e-5163-4b42-a008-a576413c0b37 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.188606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.221060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 887/1782] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:02 2022] PUT /identity/v3/projects/f14653756c4c4827a50573696e5468b3/users/511d2955283f40c5b251366929e9ef75/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:02.245810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ab0b-0486-478a-a295-29c72c8f9233 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.256368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.257063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.257565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.314045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] MFA Rules not processed for user `511d2955283f40c5b251366929e9ef75`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:02.317888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:02.645564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.654010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.654547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.660776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.663876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.674300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.725072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 896/1783] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:02.727060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.730523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:02.761924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 888/1784] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:02.763416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58906a7-3496-47ae-a95e-fd31bdd54736 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.764186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.774525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.776462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.776728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.777184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] PATH_INFO: `/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.781658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfba8bd90c9b4b6faa74cf1d4a3924ee)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.785682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.841024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e1f79-1f9c-4e1e-9d98-0e7c8299b69f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.851899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.854238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.855353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.856087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.857745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.861242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.885329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 889/1785] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:02.887429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:02.931493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6538-6d84-4561-9e8f-0d195d4b661e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:02.960403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:02.961944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:02.962620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:02.963922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:02.967358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:02.973156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469f66-ec3a-44cb-b82c-a616fd2ef6e2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:02.981723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:03.102262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfba8bd90c9b4b6faa74cf1d4a3924ee', 'request_id': 'req-c124315a-68bf-4789-878d-0f01d7abe577'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:03.104548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 890/1786] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:02 2022] POST /identity/v3/projects => generated 363 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:03.107447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.108481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.109494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.148317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfba8bd90c9b4b6faa74cf1d4a3924ee', 'request_id': 'req-c124315a-68bf-4789-878d-0f01d7abe577'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:03.170194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] MFA Rules not processed for user `602aaa469bed4617b1a0385087066c93`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:03.172683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.192900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfba8bd90c9b4b6faa74cf1d4a3924ee', 'request_id': 'req-c124315a-68bf-4789-878d-0f01d7abe577'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:03.236337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] The token cache is being invalidate because project dfba8bd90c9b4b6faa74cf1d4a3924ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:03.237102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:03.241598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:03.247844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 897/1787] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:02 2022] DELETE /identity/v3/projects/dfba8bd90c9b4b6faa74cf1d4a3924ee => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:03.249562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:03.254406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.320329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 891/1788] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:03.320329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:03.320329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.398507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:03.458313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124315a-68bf-4789-878d-0f01d7abe577 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:03.463627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44edb6a-575a-411c-b3ba-eb3cb0ae021d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:03.470767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:03.471553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.471937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.472364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.473197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:03.476142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661fe1-f2d6-4343-9ba7-e779a6ad6be8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:03.484640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:03.489867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.491371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.493247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] PATH_INFO: `/v3/projects/1b681057d1de415193f3e1ead78bf2aa/users/0a409d14f7da4577be02165214319ebf/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.508764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 892/1789] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:03 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:03.511343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.512663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.513209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.551120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:03.555429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.567075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b681057d1de415193f3e1ead78bf2aa, user_id=0a409d14f7da4577be02165214319ebf, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:03.571500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 893/1790] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:03.572985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:03.575316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.586702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:03.631360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 898/1791] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:03 2022] PUT /identity/v3/projects/1b681057d1de415193f3e1ead78bf2aa/users/0a409d14f7da4577be02165214319ebf/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:03.648077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:03.686371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:03.718675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da7c6d-b118-4446-b382-2bcb51559f6d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:03.805068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987400ea-4c16-4bd4-b2cc-8fd52e5a0a00 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:03.815052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:03.816267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.816728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.817183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.818634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:03.821925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b81c-9154-48fd-b832-94c5226cd94c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:03.850232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 899/1792] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:03.852985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace82a8-0d7a-43f8-8d49-6fafefe52a45 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.853438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace82a8-0d7a-43f8-8d49-6fafefe52a45 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.853971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace82a8-0d7a-43f8-8d49-6fafefe52a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.869977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:03.871938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.872750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.873193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:03.895851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4ace82a8-0d7a-43f8-8d49-6fafefe52a45 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:03.898858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4ace82a8-0d7a-43f8-8d49-6fafefe52a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:03.922870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 900/1793] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:03.925016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:03.925459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:03.925927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.045152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] MFA Rules not processed for user `0a409d14f7da4577be02165214319ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:04.053729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:04.097845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.104839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.176799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 894/1794] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:04.182974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.276845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8b997-085a-44dd-bd3a-f00c29033016 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.303555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.304816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.309964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.310742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] PATH_INFO: `/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2/users/7d760602f1cb4892b22fcab9707b4c22/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.354681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdef12f82e514e8ba5a2c3e7f4d48ec2, user_id=7d760602f1cb4892b22fcab9707b4c22, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.371130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165240c-4d6c-4165-af2f-b009de1ade48 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.412054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 901/1795] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:04.414137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.418022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 895/1796] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:04 2022] PUT /identity/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2/users/7d760602f1cb4892b22fcab9707b4c22/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:04.426701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.427577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.428260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.464605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea779-afce-44fe-9fce-9c77186bb2a3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.487568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] MFA Rules not processed for user `8713cb23a93147f8b52f88e240c81d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:04.491531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:04.557885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:04.578889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.579581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.580245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.580527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.581487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:04.581801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.583756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.602901 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 902/1797] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:04.603919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.617713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0883423-1dc9-4543-b44d-3552142c320c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.627707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.628445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.628732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.629011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.629969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.631726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.645662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 896/1798] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:04.654095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.674497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9a54f-9f5e-47ff-8369-e9c9dad60de3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.678455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 903/1799] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:04.679415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.686782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.687483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.687848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.689150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.689150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.690543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.703783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 897/1800] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:04.705194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.710922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:04.718793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03b6e2-3693-4cdd-bcb2-3ac4bfc670a6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.854028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.854827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.855036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.855313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.856080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.861484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf422-6c98-40ea-a4ce-cb2c6dd91b85 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.862837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.876353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.877062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.877350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.877626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.878399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.880457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.907743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 898/1801] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:04 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:04.907743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.927064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb59d-4f89-4c58-a518-6988c0f835a8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:04.946884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 904/1802] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:04 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:04.948070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:04.949296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:04.950266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:04.950554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:04.950833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] PATH_INFO: `/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2/users/7d760602f1cb4892b22fcab9707b4c22/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:04.960725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdef12f82e514e8ba5a2c3e7f4d48ec2, user_id=7d760602f1cb4892b22fcab9707b4c22, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:04.964887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:04.993983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 899/1803] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:04 2022] PUT /identity/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2/users/7d760602f1cb4892b22fcab9707b4c22/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:04.997019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:05.101385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906709e-250f-47e9-9fbf-bc755f855372 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.226499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:05.252857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.253619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.253905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.254224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.256071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adef2b3-5522-48be-b920-8922d7480557 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.256345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.258135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e37bd-de81-43a9-bacb-2d290f83f45c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.271384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.273254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.273912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.274532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.278032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.283885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.311345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 905/1804] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:05.313420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.313718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.314002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.368147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] MFA Rules not processed for user `7d760602f1cb4892b22fcab9707b4c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:05.369667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:05.369850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 900/1805] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:04 2022] POST /identity/v3/users => generated 287 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:05.372257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:05.414446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57478917-7d88-4a40-be87-7bbb33d3366d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.442322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.443257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.443538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.443813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] PATH_INFO: `/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad/users/5515ce314fa546f7ad9b750176b85513/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.496911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffabab1cea394a46b6ee17d7d2e4e4ad, user_id=5515ce314fa546f7ad9b750176b85513, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.500362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.543721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 901/1806] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:05 2022] PUT /identity/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad/users/5515ce314fa546f7ad9b750176b85513/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:05.544734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:05.579271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 906/1807] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:05.582472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:05.608020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324529-bc79-4e07-94a7-0f07b5040437 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.787845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:05.797175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.797903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.798193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.798472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.799234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.814783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.857247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 907/1808] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:05.858283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:05.875500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbee90-3b3d-4c2b-9fb2-a02fbfc65c2c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.897331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d837a-e7b6-4279-a42d-66b2b57621d6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:05.900096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.902317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.907709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.908238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.913092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:05.915440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.917697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:05.919985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:05.921565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] PATH_INFO: `/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad/users/5515ce314fa546f7ad9b750176b85513/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:05.924328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0de501-568a-407f-8025-635e4d321eae admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.927766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffabab1cea394a46b6ee17d7d2e4e4ad, user_id=5515ce314fa546f7ad9b750176b85513, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:05.945505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:05.996686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 902/1810] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:05.996944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 908/1810] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:05 2022] PUT /identity/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad/users/5515ce314fa546f7ad9b750176b85513/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:06.000032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:06.014353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.015355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.015513 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.066982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] MFA Rules not processed for user `5515ce314fa546f7ad9b750176b85513`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:06.068217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:06.156675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 903/1811] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:06.157824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:06.159314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:06.234508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fecfa3-1c0a-497f-a00d-aa5dc2239db0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:06.239120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:06.240098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.240345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.240625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.423881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:06.429216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:06.429698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:06.457514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1893-87ed-4a60-8756-4ff8b1c706e3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:06.458435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 904/1812] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:06.473261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:06.476227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.477010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.477720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.480087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:06.486147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:06.527418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:06.538812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44e8d-7a81-42a6-86fe-1937fcb1ecb3 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:06.555954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 909/1813] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:06.556224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:06.556224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.556224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.556224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.566075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:06.584624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:06.616721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9bb5-fa93-4171-a115-c8072e9b750e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:06.646672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:06.650753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.653330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.656690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] PATH_INFO: `/v3/projects/ba640ea9f70d4293a2e2fcfec2f74869/users/4ca30ffbc2b84785a0b56d0596ed81d7/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.670065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:06.671801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:06.684949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 905/1814] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:06.731086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba640ea9f70d4293a2e2fcfec2f74869, user_id=4ca30ffbc2b84785a0b56d0596ed81d7, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:06.745142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e2d3-6062-44d5-9a53-058a2dd6305a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:06.784095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:06.785810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:06.804686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a16be-0f43-438b-8f1d-efd2a5c77ecd service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:06.835239 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 910/1815] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:06 2022] PUT /identity/v3/projects/ba640ea9f70d4293a2e2fcfec2f74869/users/4ca30ffbc2b84785a0b56d0596ed81d7/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:06.844858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.846034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.847163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.947514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] MFA Rules not processed for user `4ca30ffbc2b84785a0b56d0596ed81d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:06.949030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:06.977943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:06.979471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:06.980079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:06.980657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:06.999243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:07.191487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:07.193567 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:07.214271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 906/1816] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:07.243250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 911/1817] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:07.265961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:07.479711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560858-b09e-4520-a510-3eacaf074c9d service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:07.503025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:07.505732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:07.506560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:07.509942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:07.513550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:07.522713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:07.568603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:07.619521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 907/1818] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:07.626082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:07.651645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae837-9171-4d75-bf9e-31973f47b4b5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:07.853141 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:07.855875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:07.858204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:07.859192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:07.862722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:07.868240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:07.922705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 912/1819] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:07 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:07.927246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:07.988146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad615-563e-45a6-b5c6-a863389ef231 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:08.020247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:08.022219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:08.022951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:08.023844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:08.025767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:08.030733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:08.103040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 908/1820] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:08.107094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:08.127631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523a77-9599-421b-bfd0-8b2644cf35f7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:08.144276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:08.145758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:08.146316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:08.146832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] PATH_INFO: `/v3/projects/83399f3a4b51436390fe82bcb9a7b7de/users/bba104d1d5804e7fa85b980abc0eaa40/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:08.177086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83399f3a4b51436390fe82bcb9a7b7de, user_id=bba104d1d5804e7fa85b980abc0eaa40, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:08.184940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:08.216515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 913/1821] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:08 2022] PUT /identity/v3/projects/83399f3a4b51436390fe82bcb9a7b7de/users/bba104d1d5804e7fa85b980abc0eaa40/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:08.221478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:08.273278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c98a3d-374d-41ae-8982-72f476972875 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:08.527972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:08.529709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:08.529709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:08.530155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:08.531652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:08.535247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c571cf-d3d8-4e02-95cf-51e8ed207bf1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:08.559193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 909/1822] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:08.563811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:08.580761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062e56-0c48-427f-897b-eec4ec445565 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:08.598533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:08.602945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:08.603656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:08.604428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] PATH_INFO: `/v3/projects/83399f3a4b51436390fe82bcb9a7b7de/users/bba104d1d5804e7fa85b980abc0eaa40/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:08.617589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83399f3a4b51436390fe82bcb9a7b7de, user_id=bba104d1d5804e7fa85b980abc0eaa40, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:08.628084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:08.711749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 914/1823] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:08 2022] PUT /identity/v3/projects/83399f3a4b51436390fe82bcb9a7b7de/users/bba104d1d5804e7fa85b980abc0eaa40/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:08.718485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:08.719651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:08.720120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:08.788331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] MFA Rules not processed for user `bba104d1d5804e7fa85b980abc0eaa40`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:08.789559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:08.967552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 910/1824] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:08.987266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:09.054811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:09.207155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b531c0-c716-4d6c-9963-b3602f405197 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:09.223243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:09.224816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:09.225354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:09.228540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:09.272710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:09.272710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cdd07-176e-4213-9a96-08d026c62612 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:09.291329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 915/1825] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:09.472565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:09.494756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ea06-256b-4c35-8240-91dc9751e43d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:09.495365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ea06-256b-4c35-8240-91dc9751e43d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:09.496039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ea06-256b-4c35-8240-91dc9751e43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:09.513370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acabd9b-f6c4-4e6c-8650-524e979e546f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:09.533936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-16f6ea06-256b-4c35-8240-91dc9751e43d None None] MFA Rules not processed for user `602aaa469bed4617b1a0385087066c93`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:09.535574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-16f6ea06-256b-4c35-8240-91dc9751e43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:09.553022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:09.559247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:09.559876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:09.562602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:09.708717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 916/1826] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:09.776124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:09.779265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e6823-b067-4c9e-976b-a58bed202898 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:09.820832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 911/1827] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:10.873402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:10.874509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:10.874509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:10.875587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 917/1828] 10.222.0.33 () {54 vars in 912 bytes} [Mon Jun 6 21:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 21:05:10.883269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:10.884215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:10.884386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:10.902670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:10.923929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:10.928254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:11.039048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 912/1829] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:11.074186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:11.080559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:11.155954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef44e9-d0bf-4191-8777-01a63b9b9a76 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:11.173541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:11.174995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:11.179406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:11.179918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:11.232757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:11.235914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93908e72-62ba-4199-a3d6-73324f377577 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:11.281634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 918/1830] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:11.924736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:12.003267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18e8b-78f1-4f42-8e16-f2a328e07336 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:12.004102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18e8b-78f1-4f42-8e16-f2a328e07336 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:12.004102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a18e8b-78f1-4f42-8e16-f2a328e07336 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:12.005886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 919/1831] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 21:05:12.024866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:12.025038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:12.025595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:12.068375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:12.070059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:12.107409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc1d4d-6f39-483f-b881-a02558291672 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:12.122532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:12.126685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:12.127405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:12.128194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] PATH_INFO: `/v3/users/511d2955283f40c5b251366929e9ef75` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:12.132327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=511d2955283f40c5b251366929e9ef75)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:12.135961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: WARNING py.warnings [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:05:12.135961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: warnings.warn(msg) Jun 06 21:05:12.135961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: Jun 06 21:05:12.142006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:12.243671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 920/1832] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:12.276216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:12.307868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b907dda-5302-434b-b242-b89a4981caf2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:12.318001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:12.320282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:12.320905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:12.321477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:12.335875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:12.338270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0284d0-aee4-4d6f-b92b-dc2d142a3436 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:12.364384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 921/1833] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:12.369611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511d2955283f40c5b251366929e9ef75'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:12.415851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511d2955283f40c5b251366929e9ef75'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:12.441561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511d2955283f40c5b251366929e9ef75'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:12.476114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511d2955283f40c5b251366929e9ef75'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:12.476967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511d2955283f40c5b251366929e9ef75'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:12.508413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 913/1834] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:11 2022] DELETE /identity/v3/users/511d2955283f40c5b251366929e9ef75 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:12.514497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:12.515230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:12.515741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:12.561164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:12.564726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:12.623894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:12.728101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 922/1835] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:12.804951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:12.806485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:12.922049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:12.991167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20657e87-a472-4cb4-a1aa-01b26667bb6d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:13.001843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:13.002675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:13.002964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:13.003300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:13.023958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:13.025914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:13.053607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 914/1836] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:14.338387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:14.343090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:14.372203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6918-e37f-4e3f-9ebd-2412d7b204bd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:14.379931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:14.381291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:14.381879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:14.382371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] PATH_INFO: `/v3/projects/f14653756c4c4827a50573696e5468b3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:14.385120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14653756c4c4827a50573696e5468b3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:14.387636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:14.472849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14653756c4c4827a50573696e5468b3', 'request_id': 'req-55077eca-1445-4c13-8f7e-9664f35c5d8a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.484211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14653756c4c4827a50573696e5468b3', 'request_id': 'req-55077eca-1445-4c13-8f7e-9664f35c5d8a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.495882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14653756c4c4827a50573696e5468b3', 'request_id': 'req-55077eca-1445-4c13-8f7e-9664f35c5d8a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.515452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] The token cache is being invalidate because project f14653756c4c4827a50573696e5468b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:14.516084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.517059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.520251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 923/1837] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:14 2022] DELETE /identity/v3/projects/f14653756c4c4827a50573696e5468b3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:14.525556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:14.537873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f13e-4a7d-4445-8553-fa49dd9f92e5 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:14.606104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:14.606895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:14.607175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:14.607488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] PATH_INFO: `/v3/users/7d760602f1cb4892b22fcab9707b4c22` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:14.609264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d760602f1cb4892b22fcab9707b4c22)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:14.611264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:14.684179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d760602f1cb4892b22fcab9707b4c22'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.702367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d760602f1cb4892b22fcab9707b4c22'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.717450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d760602f1cb4892b22fcab9707b4c22'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.733657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d760602f1cb4892b22fcab9707b4c22'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.734198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d760602f1cb4892b22fcab9707b4c22'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:14.744087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 915/1838] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:14 2022] DELETE /identity/v3/users/7d760602f1cb4892b22fcab9707b4c22 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:15.067000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:15.069143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.161161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077eca-1445-4c13-8f7e-9664f35c5d8a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:15.246697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:15.248536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:15.249128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:15.249720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:15.274251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.286821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:15.288710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.375707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:15.443477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:15.486945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e99b-793a-4e0b-8013-b55cea0326b2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:15.510283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:15.511206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:15.511495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:15.511773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] PATH_INFO: `/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:15.513186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdef12f82e514e8ba5a2c3e7f4d48ec2)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:15.515672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:15.566857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:15.568574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb9462-5a7c-4f89-b925-1cecd2dcf8b9 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:15.591406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 924/1839] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:15.661402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdef12f82e514e8ba5a2c3e7f4d48ec2', 'request_id': 'req-9ca128fc-0409-439a-b24e-d12c84fae9b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:15.678035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdef12f82e514e8ba5a2c3e7f4d48ec2', 'request_id': 'req-9ca128fc-0409-439a-b24e-d12c84fae9b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:15.693260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdef12f82e514e8ba5a2c3e7f4d48ec2', 'request_id': 'req-9ca128fc-0409-439a-b24e-d12c84fae9b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:15.721990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] The token cache is being invalidate because project cdef12f82e514e8ba5a2c3e7f4d48ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:15.722449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:15.727588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:15.727588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 916/1840] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:15 2022] DELETE /identity/v3/projects/cdef12f82e514e8ba5a2c3e7f4d48ec2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:15.735482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1839a-8a3b-4057-b1b5-e41bb84b8d9d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:15.737582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1839a-8a3b-4057-b1b5-e41bb84b8d9d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:15.738578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1839a-8a3b-4057-b1b5-e41bb84b8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:15.775217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-efa1839a-8a3b-4057-b1b5-e41bb84b8d9d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:15.777675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-efa1839a-8a3b-4057-b1b5-e41bb84b8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.916230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 925/1841] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:15.927492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:15.930574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:15.930908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:15.931429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:15.932159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.959302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:15.959845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca128fc-0409-439a-b24e-d12c84fae9b4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:15.960664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:15.971896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:15.973950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:15.974110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 926/1842] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:15.974886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:15.975386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] PATH_INFO: `/v3/users/0f3c3ef050044c04bab6700221920b4c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:15.977995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3c3ef050044c04bab6700221920b4c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:15.981219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:15.986133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.000192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ee85a-fe51-46b9-83f8-9ba439e1b22d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.005763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.006751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.007059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.007597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.008685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:16.009058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.010716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.025235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 927/1843] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:16.031945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.049072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c0ba-a32c-4f7a-87c0-9eae079fb794 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.058377 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.059616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.060480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.061039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.063412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.066521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.102767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3c3ef050044c04bab6700221920b4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:16.120316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 928/1844] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:16.127280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.148509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3c3ef050044c04bab6700221920b4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:16.162203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3c3ef050044c04bab6700221920b4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:16.182210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3c3ef050044c04bab6700221920b4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:16.183351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bb2e2341-d3a2-4eb3-8dca-64df7a62c544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3c3ef050044c04bab6700221920b4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:16.199877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 917/1845] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:15 2022] DELETE /identity/v3/users/0f3c3ef050044c04bab6700221920b4c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:16.202316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.202614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.202959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.248670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:16.252935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:16.268275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016fe4-e302-4326-8ecd-9bbf81478694 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.285306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:16.336451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:16.349987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.350789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.351176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.354527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.354527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.355273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.362097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 918/1846] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:16.380099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.388067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:16.388935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 929/1847] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:16.392886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.394815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:16.418014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8935d-1f64-4cef-bae1-63e704eb2c26 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.424152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.424868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.425162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.425453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.426192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.428038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.443867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 930/1848] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:16.447431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.467121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a591-2a44-438f-ac9c-ad87efe5c096 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.475215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.476420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.476903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.477367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.478729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.481827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.493107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca05555-aa7f-4fd9-946a-d0f63e3dbf4e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.497320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.498110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.498701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.498986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.504019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 931/1849] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:16.507875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.509767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.511259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be784978-1b91-457c-a69f-ea386fffdf76 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.519661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae489-1adc-4f6d-aa6b-a069df22ccdd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.524710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 919/1850] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:16.527043 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.528412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.528412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.528731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] PATH_INFO: `/v3/projects/6e0782063fde4561a27cf793ead516a4/users/e584ad63689d4edd80dcf1bde4c55a86/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.554716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0782063fde4561a27cf793ead516a4, user_id=e584ad63689d4edd80dcf1bde4c55a86, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.560066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.600801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 932/1851] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:16 2022] PUT /identity/v3/projects/6e0782063fde4561a27cf793ead516a4/users/e584ad63689d4edd80dcf1bde4c55a86/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:16.620479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.621038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.621316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.654489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] MFA Rules not processed for user `e584ad63689d4edd80dcf1bde4c55a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:16.655868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:16.750414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 920/1852] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:16.756636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.859368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059457cc-1d22-45a3-889c-3c6d804bdf3e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.864652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:16.865382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:16.865839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:16.866134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:16.866995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:16.869014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:16.911513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 933/1853] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:16.915869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.928217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2877875-9146-4e9d-8aca-c72136958528 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:16.971355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:16.974658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:17.033310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.034592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.038925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.038925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.038925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.041777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.083251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 921/1854] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:16 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:17.089466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.089910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:17.102177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669230-d4a1-4a1b-a7c3-afbb572bb92a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.108729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.109431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.109712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.109986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.110807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.112486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.122585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37b72f-09ae-47d2-8c26-530821509508 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.132190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.133923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.134358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 922/1855] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:17.139763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.140159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] PATH_INFO: `/v3/projects/7699d31d2c494ae2b10835d7f95d17e5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.141725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.142135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7699d31d2c494ae2b10835d7f95d17e5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.146968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.160993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f4d-b30e-41ef-91ea-7ae2618f5342 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.169582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.171748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.172303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.172875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] PATH_INFO: `/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c/users/2380e667e8f4490f86e29ac903a64746/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.177508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:17.198334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dbeed7d0c745cd87af59173ffc3d6c, user_id=2380e667e8f4490f86e29ac903a64746, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.203102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.210962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7699d31d2c494ae2b10835d7f95d17e5', 'request_id': 'req-a8b5f697-132b-4e39-bd1a-9e08bab38417'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.224496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7699d31d2c494ae2b10835d7f95d17e5', 'request_id': 'req-a8b5f697-132b-4e39-bd1a-9e08bab38417'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.226958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 923/1856] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:17 2022] PUT /identity/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c/users/2380e667e8f4490f86e29ac903a64746/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:17.233266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.235088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7699d31d2c494ae2b10835d7f95d17e5', 'request_id': 'req-a8b5f697-132b-4e39-bd1a-9e08bab38417'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.257940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] The token cache is being invalidate because project 7699d31d2c494ae2b10835d7f95d17e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:17.258440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.259351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.261608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 934/1857] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:16 2022] DELETE /identity/v3/projects/7699d31d2c494ae2b10835d7f95d17e5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:17.266113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.267600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:17.367544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5f697-132b-4e39-bd1a-9e08bab38417 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.372773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.374291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.374733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.375019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] PATH_INFO: `/v3/users/07ead170b426407b9de9f4af75ba521f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.376486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ead170b426407b9de9f4af75ba521f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.378765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.381442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec2fb1-7df6-470c-874f-674c14cf8f2f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.390679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.391749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.392184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.392679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.394112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.397362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.417031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 924/1858] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:17.423863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.426309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:17.441061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51a883-ad41-44a1-be27-afdd2fc81891 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.446610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.447640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.447881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.448297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] PATH_INFO: `/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c/users/2380e667e8f4490f86e29ac903a64746/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.450684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dbeed7d0c745cd87af59173ffc3d6c, user_id=2380e667e8f4490f86e29ac903a64746, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.455023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9357-dd0e-47d4-b618-d69ed3acbb2f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:17.465328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ead170b426407b9de9f4af75ba521f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.476605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ead170b426407b9de9f4af75ba521f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.480117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 925/1859] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:17 2022] PUT /identity/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c/users/2380e667e8f4490f86e29ac903a64746/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:17.495083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ead170b426407b9de9f4af75ba521f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.496189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ead170b426407b9de9f4af75ba521f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.501789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.502308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.502452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.512264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:17.525804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ead170b426407b9de9f4af75ba521f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:17.551645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 935/1860] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:17 2022] DELETE /identity/v3/users/07ead170b426407b9de9f4af75ba521f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:17.574134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] MFA Rules not processed for user `2380e667e8f4490f86e29ac903a64746`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:17.576116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:17.775641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 926/1861] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:17.801148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:17.802875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:17.935089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e52-6610-4daa-b960-998679d0369f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:17.942656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:17.943923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:17.944746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:17.945336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:17.965581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:17.968919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed323700-c2b8-4763-a708-d1210aa759f3 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:18.009703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 936/1862] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:18.161737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:18.164790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:18.414830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:18.510433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb5961-f74f-49c6-9795-14cd9e3a4aae None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:18.521012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:18.522052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:18.522335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:18.522713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] PATH_INFO: `/v3/users/e584ad63689d4edd80dcf1bde4c55a86` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:18.530524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e584ad63689d4edd80dcf1bde4c55a86)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:18.532977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:18.650227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e584ad63689d4edd80dcf1bde4c55a86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:18.668287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e584ad63689d4edd80dcf1bde4c55a86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:18.687861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e584ad63689d4edd80dcf1bde4c55a86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:18.709289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e584ad63689d4edd80dcf1bde4c55a86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:18.711668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e584ad63689d4edd80dcf1bde4c55a86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:18.733647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:18.734528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:18.734528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:18.736091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 927/1863] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:18 2022] DELETE /identity/v3/users/e584ad63689d4edd80dcf1bde4c55a86 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:18.769499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:18.770677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:18.932253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 937/1864] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:18.943610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:18.945776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:19.053511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:19.055737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:19.079469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505a79-3cc3-442d-af14-db933f0c456b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:19.090526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:19.096119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:19.096415 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:19.096756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] PATH_INFO: `/v3/users/984460544f4649f79f564832915bc2d4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:19.102617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=984460544f4649f79f564832915bc2d4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:19.108637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:19.169666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068291e6-1d65-41b0-bc1b-1be1e159edd8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:19.187862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:19.188610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:19.188893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:19.189276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:19.265783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:19.275942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d9487-0220-45c2-a132-6b69c1d9dff8 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:19.352646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984460544f4649f79f564832915bc2d4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:19.386272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 928/1865] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:19.396997 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984460544f4649f79f564832915bc2d4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:19.450780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984460544f4649f79f564832915bc2d4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:19.462263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984460544f4649f79f564832915bc2d4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:19.483316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984460544f4649f79f564832915bc2d4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:19.497481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 938/1866] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:19 2022] DELETE /identity/v3/users/984460544f4649f79f564832915bc2d4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:19.506112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:19.507498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:19.508357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:19.567895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:19.573164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:19.755844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:19.758332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:19.790839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:19.868818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 929/1867] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:19.917432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:19.922695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:19.946236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fbb2-ee80-424c-8079-59ffde501f5c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:19.968610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:19.969530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:19.969811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:19.970087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] PATH_INFO: `/v3/projects/e6f5082f8c9b484c934b6d2d49394a59` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:19.971489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f5082f8c9b484c934b6d2d49394a59)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:19.973509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:19.975876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:20.095862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f5082f8c9b484c934b6d2d49394a59', 'request_id': 'req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:20.113970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f5082f8c9b484c934b6d2d49394a59', 'request_id': 'req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:20.133442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f5082f8c9b484c934b6d2d49394a59', 'request_id': 'req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:20.162967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c8dac-b8d8-4117-8a8d-5020c09345ab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:20.171233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] The token cache is being invalidate because project e6f5082f8c9b484c934b6d2d49394a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:20.172238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:20.174773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4029fb73-c481-4aab-95d4-1b9b8c59ebcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:20.182691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 939/1868] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:19 2022] DELETE /identity/v3/projects/e6f5082f8c9b484c934b6d2d49394a59 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:20.191608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae550-f301-42f1-b570-1d8acb130054 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:20.192135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae550-f301-42f1-b570-1d8acb130054 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:20.192664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ae550-f301-42f1-b570-1d8acb130054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:20.262886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-628ae550-f301-42f1-b570-1d8acb130054 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:20.265611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-628ae550-f301-42f1-b570-1d8acb130054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:20.377601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:20.380987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:20.381495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:20.381971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:20.395635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:20.549148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 940/1869] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:20.552641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:20.553040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:20.553424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:20.634920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:20.636617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:20.659847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 941/1870] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:20.665085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:20.678492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d509-d5d5-4ea8-8e26-39c2194444a5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:20.699717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:20.700665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:20.701236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:20.701666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:20.702728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:20.703193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:20.705472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:20.745941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 942/1871] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:20.747714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:20.770309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389154-6bb6-45d2-88f5-ed18becd3772 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:20.785216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:20.786362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:20.786857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:20.787237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:20.788869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:20.792789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:20.801346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:20.813985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:20.855594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:20.868270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 930/1872] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 952 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:20.877850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:20.878366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 943/1873] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:20 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:20.908661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60790a1-42b0-4583-bbef-20d7276ed826 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.074864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:21.078581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:21.087032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.089456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.089839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.090255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.091467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.095716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.128689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac0f9-4b5f-4c18-8328-6449048ce749 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.149212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 931/1874] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:20 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:21.151082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.152869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.153358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.153851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] PATH_INFO: `/v3/projects/6e0782063fde4561a27cf793ead516a4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.155148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:21.159927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0782063fde4561a27cf793ead516a4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.163847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.176209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c27a-95d7-4420-ab14-13a520443b2e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.187612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.188354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.188840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.189134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.190194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.191975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.199541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:21.222424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 932/1875] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:21.225214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:21.240071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842f70-7e5a-41e2-82f7-e60e965bf6a4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.246668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.247953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.248711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.249587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.250715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.253499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.277180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 933/1876] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:21.278674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:21.292318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834fec-046a-414e-8dd2-1396e499363f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.365975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0782063fde4561a27cf793ead516a4', 'request_id': 'req-7abd1875-d188-40f9-9e52-d3641eeec5a2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.374206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0782063fde4561a27cf793ead516a4', 'request_id': 'req-7abd1875-d188-40f9-9e52-d3641eeec5a2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.390267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0782063fde4561a27cf793ead516a4', 'request_id': 'req-7abd1875-d188-40f9-9e52-d3641eeec5a2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.417812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] The token cache is being invalidate because project 6e0782063fde4561a27cf793ead516a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:21.418796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.420690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.424926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.426559 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 944/1877] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:21 2022] DELETE /identity/v3/projects/6e0782063fde4561a27cf793ead516a4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:21.426752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.426752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.426752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] PATH_INFO: `/v3/projects/74a0282aeb7a4d9abec32ef7fdbf23e7/users/a95936a804054e969786bc5a1a3e0eb0/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.430186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:21.433543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:21.463192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd1875-d188-40f9-9e52-d3641eeec5a2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:21.467539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a0282aeb7a4d9abec32ef7fdbf23e7, user_id=a95936a804054e969786bc5a1a3e0eb0, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.472322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c07e2-737c-4936-852f-c8f888cf80ff admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.477225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:21.478646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.479268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.480427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] PATH_INFO: `/v3/users/2380e667e8f4490f86e29ac903a64746` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.483200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2380e667e8f4490f86e29ac903a64746)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:21.485811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:21.531169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 934/1878] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:21 2022] PUT /identity/v3/projects/74a0282aeb7a4d9abec32ef7fdbf23e7/users/a95936a804054e969786bc5a1a3e0eb0/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:21.548629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:21.549146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:21.550141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:21.605433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] MFA Rules not processed for user `a95936a804054e969786bc5a1a3e0eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:21.608842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:21.766467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2380e667e8f4490f86e29ac903a64746'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.812209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2380e667e8f4490f86e29ac903a64746'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.865136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2380e667e8f4490f86e29ac903a64746'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.867582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2380e667e8f4490f86e29ac903a64746'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.900815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2380e667e8f4490f86e29ac903a64746'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:21.930028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 945/1879] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:21 2022] DELETE /identity/v3/users/2380e667e8f4490f86e29ac903a64746 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:22.002553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 935/1880] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:22.009440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:22.019362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:22.325716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:22.345092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b133-c825-4706-9e65-fb0e21824504 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:22.356740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:22.360936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:22.361286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:22.361629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:22.362708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:22.366030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:22.424367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 946/1881] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:22 2022] POST /identity/v3/projects => generated 363 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:22.431444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:22.553904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:22.558371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:22.644600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666db62a-3560-4af9-8c78-d9515e6c83f5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:22.667671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:22.810124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092d9a-ac18-44fe-bd07-1d3960aac7b3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:22.819733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:22.820894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:22.821391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:22.821698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] PATH_INFO: `/v3/projects/1c0db83101ae45ab94b6d0c9ccecd5e0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:22.823917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0db83101ae45ab94b6d0c9ccecd5e0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:22.826453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:22.897554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:22.898591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:22.901695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:22.903777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:22.905059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:22.912155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3b33-5ac4-428f-bcd4-8cfa4945906e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:22.932399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0db83101ae45ab94b6d0c9ccecd5e0', 'request_id': 'req-2e169668-b59a-43a9-9106-68c215a23482'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:22.948677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0db83101ae45ab94b6d0c9ccecd5e0', 'request_id': 'req-2e169668-b59a-43a9-9106-68c215a23482'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:22.963393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0db83101ae45ab94b6d0c9ccecd5e0', 'request_id': 'req-2e169668-b59a-43a9-9106-68c215a23482'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.000291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 936/1882] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:22 2022] POST /identity/v3/users => generated 288 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:23.004259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.004870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.005225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.007742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 937/1883] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:05:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:05:23.009012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] The token cache is being invalidate because project 1c0db83101ae45ab94b6d0c9ccecd5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:23.009323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.009483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.011675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.012430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.022269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 947/1884] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:22 2022] DELETE /identity/v3/projects/1c0db83101ae45ab94b6d0c9ccecd5e0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:23.022269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.024451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.166920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169668-b59a-43a9-9106-68c215a23482 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:23.174353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:23.175074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.175356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.175632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.176441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:23.179402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:23.195383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 948/1885] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:23.196442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.198407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.218328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa3c9f-58ba-4577-a98b-d4c1e6fa46db admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:23.226243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:23.227800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.228109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.228609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] PATH_INFO: `/v3/users/a6ffed09fc35433a8814fc38da933f7d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.230915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ffed09fc35433a8814fc38da933f7d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:23.234894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:23.237840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:23.289083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a31aa-b304-4c64-8c90-fe424e40c6cf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:23.304377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:23.306179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.306808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.307734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] PATH_INFO: `/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.310744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dbeed7d0c745cd87af59173ffc3d6c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:23.315420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:23.366601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ffed09fc35433a8814fc38da933f7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.376877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ffed09fc35433a8814fc38da933f7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.400313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ffed09fc35433a8814fc38da933f7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.406712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dbeed7d0c745cd87af59173ffc3d6c', 'request_id': 'req-cb84ecd7-08f6-404d-a981-937868ac6f4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.407206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ffed09fc35433a8814fc38da933f7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.418517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dbeed7d0c745cd87af59173ffc3d6c', 'request_id': 'req-cb84ecd7-08f6-404d-a981-937868ac6f4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.427358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-22299ec5-bd91-4a27-bf53-4889e7511735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ffed09fc35433a8814fc38da933f7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.434885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dbeed7d0c745cd87af59173ffc3d6c', 'request_id': 'req-cb84ecd7-08f6-404d-a981-937868ac6f4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.456503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 949/1886] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:23 2022] DELETE /identity/v3/users/a6ffed09fc35433a8814fc38da933f7d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:23.458849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.466889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] The token cache is being invalidate because project a8dbeed7d0c745cd87af59173ffc3d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:23.467377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.469676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.470609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.470921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.477817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 938/1887] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:23 2022] DELETE /identity/v3/projects/a8dbeed7d0c745cd87af59173ffc3d6c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:23.477817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.480371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.530910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:23.532280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.579320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:23.670254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84ecd7-08f6-404d-a981-937868ac6f4b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:23.678567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 950/1888] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:23.679957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.683685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.779450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504f8a1-7180-4328-92cd-753af221f7da None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:23.785841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:23.790534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:23.791698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.792114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.792498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] PATH_INFO: `/v3/projects/2a79c6f23df44ee88fad80c8b3665119/users/670b18305d8b497695bfa8f3f7d18ac4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.798504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.798819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.799100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] PATH_INFO: `/v3/users/0a409d14f7da4577be02165214319ebf` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.801681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a409d14f7da4577be02165214319ebf)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:23.804281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:23.814255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c6f23df44ee88fad80c8b3665119, user_id=670b18305d8b497695bfa8f3f7d18ac4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:23.818135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1824-ded2-4744-be90-d3b9fd32af23 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:23.824710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:23.850414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 939/1889] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:23 2022] PUT /identity/v3/projects/2a79c6f23df44ee88fad80c8b3665119/users/670b18305d8b497695bfa8f3f7d18ac4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:23.851942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:23.852339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:23.852840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:23.891383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:23.893028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:23.904826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a409d14f7da4577be02165214319ebf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.925041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a409d14f7da4577be02165214319ebf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.944888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a409d14f7da4577be02165214319ebf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.947329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a409d14f7da4577be02165214319ebf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.961156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a409d14f7da4577be02165214319ebf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:23.977774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 951/1890] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:23 2022] DELETE /identity/v3/users/0a409d14f7da4577be02165214319ebf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:23.979124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:23.982786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.075148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 940/1891] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:24.083755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.083755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.098730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a3a0-53cd-41f5-95c7-0804b366c9ea None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.215576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06286-2bff-47fa-b49d-a7bb8aefdb65 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.219935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:24.229688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.230535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.231207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.231207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.235495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.239169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.240642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.244475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.244760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.245731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.252806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1c53-70d8-4d8e-90ad-469dba5524cf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.263713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.267927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d053a5-6042-4874-b6db-f64586f95939 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.276542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 941/1892] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:24.276542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.276542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.276542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.288846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 952/1893] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:24.290271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.290578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.291118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.327970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:24.330086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.340903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:24.348441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 942/1894] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:24.348441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.348441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.349638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.363232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300fad9-3371-4081-aa89-c77327cac661 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.365878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 953/1895] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:24.368056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.374300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.375930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.377130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.377749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] PATH_INFO: `/v3/projects/92c286db330f433e8649b7de9ce56ac0` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.379907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c286db330f433e8649b7de9ce56ac0)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.381843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bee90-97f3-49df-9796-13e4b7d79af2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.382203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.398920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.400580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.401067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.401716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] PATH_INFO: `/v3/projects/2a79c6f23df44ee88fad80c8b3665119/users/670b18305d8b497695bfa8f3f7d18ac4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.406056 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c6f23df44ee88fad80c8b3665119, user_id=670b18305d8b497695bfa8f3f7d18ac4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.409417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.434818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 954/1896] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:24 2022] PUT /identity/v3/projects/2a79c6f23df44ee88fad80c8b3665119/users/670b18305d8b497695bfa8f3f7d18ac4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:24.434818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.434818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.488783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c286db330f433e8649b7de9ce56ac0', 'request_id': 'req-3f1308f7-3f34-4987-9d19-6a13372f715e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:24.499701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c286db330f433e8649b7de9ce56ac0', 'request_id': 'req-3f1308f7-3f34-4987-9d19-6a13372f715e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:24.509806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c286db330f433e8649b7de9ce56ac0', 'request_id': 'req-3f1308f7-3f34-4987-9d19-6a13372f715e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:24.535442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] The token cache is being invalidate because project 92c286db330f433e8649b7de9ce56ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:24.536779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:24.537456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:24.539628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 943/1897] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:24 2022] DELETE /identity/v3/projects/92c286db330f433e8649b7de9ce56ac0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:24.543778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.545956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.589154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bbe02-9c2c-4401-886d-8a2af059301a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.624492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:24.654559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1308f7-3f34-4987-9d19-6a13372f715e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.660987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.662387 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.662674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.662947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.663716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:24.664050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.665772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a31a2-0e3a-4c67-9716-9753ab104cc8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.683539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 944/1898] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:24.684814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832bfb6-5bf7-4a09-b4d0-2a5da9464e54 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.685119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832bfb6-5bf7-4a09-b4d0-2a5da9464e54 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.685967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832bfb6-5bf7-4a09-b4d0-2a5da9464e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.754629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7832bfb6-5bf7-4a09-b4d0-2a5da9464e54 None None] MFA Rules not processed for user `670b18305d8b497695bfa8f3f7d18ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:24.762375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7832bfb6-5bf7-4a09-b4d0-2a5da9464e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.819523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.820813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.821367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.821949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.825322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.855552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.858214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ec1e-4079-4623-9e0d-70e0c50d2506 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:24.878453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 955/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:24.880823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.881324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.881813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.919568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:24.920904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:24.924862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:24.944876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 956/1900] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:24.946236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:24.961135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 945/1901] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:24.961135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.961135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.961135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.980833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ae2-a8a4-4c6f-b23b-3aa2abf131c0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:24.990571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:24.992367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:24.993317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:24.993865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:24.995139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:24.999485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.002266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:25.006839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:25.046993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 946/1902] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:25.055286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.061147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:25.075724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 957/1903] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:24 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:25.075724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.218335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38eac0-312c-4e27-9d00-c522b254b796 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.287192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.287973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.288598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.289608 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.333033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0debed-b5dd-4a03-9a49-08a2cf4bc7ea admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.342241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.342981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.343265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.343539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.344346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:25.344654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.346679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.362971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 958/1904] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:25.368831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.379023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.380369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b0705-87a2-457f-b2d6-495267dc7a7b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.380764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.387322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.388122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.388452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.388759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.389680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.395470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 947/1905] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:25.396709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.411709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.424778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2029-0512-4c5d-8866-bf74370ae531 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.438520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.439329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.439750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.440142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.440940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.443223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.459814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 959/1906] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:25 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:25.467587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.478930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888248c-10c2-481b-8f71-5afb38306edd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.489874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.490603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.490894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.491164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.491895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.493838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.524777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 960/1907] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:25.529032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.529869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 948/1908] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:25 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:25.534045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.544013 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defece2-6723-45cf-864c-194d7925701c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.616333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:25.640541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.641132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.641356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.641656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.643878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:25.650679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:25.718651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbb2cc-80f4-4a03-a9ea-4c08860cdea8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.727728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.729089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.729679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.730004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.731503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.731642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.733807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.738260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.753629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 961/1909] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:25.754871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.783666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648e00-6627-488e-9b09-6921b37059f2 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.791211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 949/1910] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:25.793175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.799902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:25.815491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.816261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.816543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.816806 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.817523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.819702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.861775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520adb9-01a2-44ba-ae52-08397f40d1c7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.881778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.886662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.888166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.892286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 962/1911] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:25 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:25.892822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] PATH_INFO: `/v3/projects/1b681057d1de415193f3e1ead78bf2aa` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:25.892910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:25.893488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b681057d1de415193f3e1ead78bf2aa)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:25.899595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:25.934529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f09b-e91b-4ce7-80c2-6ad11c6c21ab admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:25.947848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:25.949065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:25.949615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:25.949990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] PATH_INFO: `/v3/projects/6f15340c21b045c3a95d0fe0f39ebd4d/users/c26ec0d51fa340868ae949dbcf36505d/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.007936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f15340c21b045c3a95d0fe0f39ebd4d, user_id=c26ec0d51fa340868ae949dbcf36505d, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:26.015916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:26.029445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b681057d1de415193f3e1ead78bf2aa', 'request_id': 'req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.046464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b681057d1de415193f3e1ead78bf2aa', 'request_id': 'req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.075123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 963/1912] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:25 2022] PUT /identity/v3/projects/6f15340c21b045c3a95d0fe0f39ebd4d/users/c26ec0d51fa340868ae949dbcf36505d/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:26.075123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:26.084218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b681057d1de415193f3e1ead78bf2aa', 'request_id': 'req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.113477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] The token cache is being invalidate because project 1b681057d1de415193f3e1ead78bf2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:26.115094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.120177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-215adfdd-c018-4b96-8ae2-e9ba0b23efd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.124102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 950/1913] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:25 2022] DELETE /identity/v3/projects/1b681057d1de415193f3e1ead78bf2aa => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:26.131214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.131505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.131877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.216204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64022d-313a-4eca-a3f3-9dd5c2045cdb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:26.230359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] MFA Rules not processed for user `c26ec0d51fa340868ae949dbcf36505d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:26.233707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:26.236669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:26.242200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.244440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.245192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.247293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:26.250010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:26.279176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 964/1914] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:26.283202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:26.285469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:26.306358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d639c-edc4-433c-8798-4bdaf8c58648 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:26.312654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:26.314312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.314675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.315025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] PATH_INFO: `/v3/users/5515ce314fa546f7ad9b750176b85513` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.316941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5515ce314fa546f7ad9b750176b85513)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:26.319266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:26.434447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5515ce314fa546f7ad9b750176b85513'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.448966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:26.454364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 951/1915] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:26.456100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:26.458435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:26.460689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5515ce314fa546f7ad9b750176b85513'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.503300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5515ce314fa546f7ad9b750176b85513'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.505154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5515ce314fa546f7ad9b750176b85513'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.520727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ac63-9d28-41d4-9777-fab3bd8efa90 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:26.539380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:26.541168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.541603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.542762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.543840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:26.546517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5515ce314fa546f7ad9b750176b85513'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:26.551281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:26.566258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 965/1916] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:26 2022] DELETE /identity/v3/users/5515ce314fa546f7ad9b750176b85513 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:26.568470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:26.586812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:26.587544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 952/1917] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:26.592309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:26.599059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:26.614406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800c81-e0f5-4fa7-9524-0b15e5183226 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:26.639715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:26.699748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:26.701176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.701766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.702205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] PATH_INFO: `/v3/projects/a7843ef21a444a0fa76b061c2b91c0ad/users/aca095e79aba4d62b2e348d531dbe0d8/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.722493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7843ef21a444a0fa76b061c2b91c0ad, user_id=aca095e79aba4d62b2e348d531dbe0d8, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:26.726248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf5e33-d8f9-4199-8f36-353c4ff8cdcc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:26.772544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 953/1918] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:26 2022] PUT /identity/v3/projects/a7843ef21a444a0fa76b061c2b91c0ad/users/aca095e79aba4d62b2e348d531dbe0d8/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:26.816234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:26.816452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:26.817179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:26.894829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be800606-1b39-44d5-8c86-55f57e605633 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:26.944787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] MFA Rules not processed for user `aca095e79aba4d62b2e348d531dbe0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:26.961175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:27.075169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.076054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.076271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.076555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.077290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:27.079514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:27.149123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 966/1919] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:26 2022] POST /identity/v3/projects => generated 381 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:27.150321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:27.227790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 954/1920] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:27.234945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:27.287422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e30d-35b9-465a-8d1e-caa36ae991cc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:27.290047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed308d-42b0-4eea-b07e-cd8aed3e231d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:27.297979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.300185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.301675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.304337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.305227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:27.305688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.307485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.308041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.308714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.311470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:27.312165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:27.317535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:27.334944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:27.371823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 967/1921] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:27 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:27.372960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:27.376391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:27.392384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42f3b-0e9f-422f-ae7a-03ac91e3dc8f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:27.403887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.405486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.405861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.406246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] PATH_INFO: `/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.408236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffabab1cea394a46b6ee17d7d2e4e4ad)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:27.410531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:27.420253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 955/1922] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:27 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:27.422659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:27.492275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffabab1cea394a46b6ee17d7d2e4e4ad', 'request_id': 'req-11c2195c-e52e-4e24-a6d8-d456a77192da'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:27.511732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffabab1cea394a46b6ee17d7d2e4e4ad', 'request_id': 'req-11c2195c-e52e-4e24-a6d8-d456a77192da'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:27.530480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffabab1cea394a46b6ee17d7d2e4e4ad', 'request_id': 'req-11c2195c-e52e-4e24-a6d8-d456a77192da'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:27.583551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] The token cache is being invalidate because project ffabab1cea394a46b6ee17d7d2e4e4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:27.584619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:27.587662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:27.593562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 968/1923] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:27 2022] DELETE /identity/v3/projects/ffabab1cea394a46b6ee17d7d2e4e4ad => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:27.598925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:27.602446 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:27.703961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee2538-3a1f-4cab-a636-34185411d732 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:27.791350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:27.907402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.908140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.908430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.908706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.910978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:27.914033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14de73-7f99-4425-8c85-dc5c39d1bbbe admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:27.943137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 956/1924] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:27.954886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2195c-e52e-4e24-a6d8-d456a77192da admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:27.956583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.957099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.960875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.980867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:27.985947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:27.986519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:27.990073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:27.996942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.001047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.029747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:28.032300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:28.038954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 969/1925] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:27 2022] POST /identity/v3/users => generated 291 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:28.040482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.047731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:28.079450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 957/1926] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:28.080028 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b0a0e-e347-42ad-b016-2ee1aea0a433 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.080131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.080552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.081575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.081857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.082136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] PATH_INFO: `/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c/users/f13b49fe0a514ae48ba9883d50179662/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.117509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d8a7d23a264ccb8e5a65592f5f9c6c, user_id=f13b49fe0a514ae48ba9883d50179662, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.131410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.132627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c17b6-3baf-4be6-9ba8-a31198500006 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.146583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.147577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.148228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.148693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.153329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.158480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894b6b-f9cf-4aa1-b079-b5b81415e7ae admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.177756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 958/1927] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:28.179570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.179984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.180490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.218534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 970/1928] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:28 2022] PUT /identity/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c/users/f13b49fe0a514ae48ba9883d50179662/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:28.222876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.223342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:28.225773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:28.338880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:28.366300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 959/1929] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:28.367788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.378574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80052a-6e15-49bb-b09a-accc0bf8b052 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.384692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.385403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.385687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.385963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.386886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.388769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.393815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31a3d-1d07-4f2a-9c23-cf82bb05f462 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.408049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 960/1930] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:28.408049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.410784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.412683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.413218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.413744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] PATH_INFO: `/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b/users/124817c7d64743d795134df2c02aa167/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.431786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b2d4-6e8f-4407-aa8d-fbb19515be2d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.444622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.445581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.446056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.446503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.451620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ba36e45a6e4047b0aa6ed3e480ba6b, user_id=124817c7d64743d795134df2c02aa167, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.454278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:28.454278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.458622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.458907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.488149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 971/1931] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:28 2022] PUT /identity/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b/users/124817c7d64743d795134df2c02aa167/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:28.488149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.488561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 961/1932] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:28.491891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.513612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e709-5938-4f54-b117-3ce29c49e134 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.610007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f8a1-63a6-4516-ac77-4896953c8b4d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.622229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.624403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.624624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.625149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.625521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] PATH_INFO: `/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c/users/f13b49fe0a514ae48ba9883d50179662/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.625692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.626112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.626627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.628345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.628663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d8a7d23a264ccb8e5a65592f5f9c6c, user_id=f13b49fe0a514ae48ba9883d50179662, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.631694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.632207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.650347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 972/1933] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:28 2022] PUT /identity/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c/users/f13b49fe0a514ae48ba9883d50179662/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:28.651343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.655857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 962/1934] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:28.660310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.691320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1c7c-620d-4d7c-a168-31f43f389abf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.721087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:28.778324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80669-59b7-4d56-b150-9e3301ab605e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.788207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.789893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.789893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.790349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.792178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.796435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1e643-8f8b-4241-8d6a-ac1628639991 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.835326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.837282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.837651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.838241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] PATH_INFO: `/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b/users/124817c7d64743d795134df2c02aa167/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.841222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ba36e45a6e4047b0aa6ed3e480ba6b, user_id=124817c7d64743d795134df2c02aa167, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:28.849794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 973/1935] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:28.850099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:28.850253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.850253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.850253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:28.861583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 963/1936] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:28 2022] PUT /identity/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b/users/124817c7d64743d795134df2c02aa167/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:28.869219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:28.895710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] MFA Rules not processed for user `f13b49fe0a514ae48ba9883d50179662`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:28.897895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:28.971660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:28.991005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca4302-c452-4057-9747-58f808b4cbad admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:28.997667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:28.998554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:28.998841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:28.999165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.000422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.002234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc4f7-1273-4468-810b-b6aad2ca2e37 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.038131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 964/1937] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:28 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:29.038131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.038131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.038131 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.077967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] MFA Rules not processed for user `124817c7d64743d795134df2c02aa167`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:29.082887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:29.089357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 974/1938] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:29.091211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.111500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3839e-c370-4faa-a05a-47751666f181 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.118963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.120103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.120402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.120681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.123088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.125934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.148086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 975/1939] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:29.148086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.148086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:29.248533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366280-1a92-4ca6-af0b-3119d82d9fb8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.255663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.257525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.258086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.258556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.282888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.287564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.288250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 965/1940] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:29.289422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.312288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b8b5-e868-44d6-bd99-287b45dfb9f8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.321549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.322602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.323028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.323289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.324249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.326780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.334394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 976/1941] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:29.348983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 966/1942] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:29.351468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.372466 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056da0-33c2-461c-91b9-923ecbc7f5a2 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.382329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.384310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.384820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.385587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] PATH_INFO: `/v3/projects/aa3f47398e1f4613a634203523d7724a/users/4e208f6be49c49a48d222b932e3710e0/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.416385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.430391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd0da-9618-47d7-b9df-c206e7192259 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.442723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3f47398e1f4613a634203523d7724a, user_id=4e208f6be49c49a48d222b932e3710e0, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.448161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399389-bc73-47ab-b6e9-44599d10abfe admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.452914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.453669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.453952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.454221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.483530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 977/1943] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:29 2022] PUT /identity/v3/projects/aa3f47398e1f4613a634203523d7724a/users/4e208f6be49c49a48d222b932e3710e0/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:29.491298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.495471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.496808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.497095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.497402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.505792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:29.528591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 967/1944] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:29.552176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] MFA Rules not processed for user `4e208f6be49c49a48d222b932e3710e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:29.554360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:29.683643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 978/1945] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:29.689332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.708862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eda1a6-2335-450a-9f18-1948bb0e040b service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.823544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:29.824839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:29.825394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:29.825877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:29.827397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:29.831547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:29.888083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 968/1946] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:29.891470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:29.915465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbb99-aa08-40c1-b6ef-622877924d8e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:29.985015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:30.055915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.057473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.058304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.059234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.061030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.064670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.104189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 979/1947] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:29 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:30.105534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.124845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3278c-114b-4266-8376-abd6e79d2fc1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.134991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.136360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.136964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.137602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.139444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.143019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.168972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 969/1948] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:30.174719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.196850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdd7e1-8673-4adb-88b9-851c85ada519 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.207692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.209424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.210118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.211291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] PATH_INFO: `/v3/projects/71454cad96f943f5b8e8c9879a47e919/users/d764bc12698b4935bb801dc8f7672b41/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.239922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71454cad96f943f5b8e8c9879a47e919, user_id=d764bc12698b4935bb801dc8f7672b41, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.245505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.276903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 980/1949] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:30 2022] PUT /identity/v3/projects/71454cad96f943f5b8e8c9879a47e919/users/d764bc12698b4935bb801dc8f7672b41/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:30.282169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.295604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23f97-123a-4a05-b0b3-360ba573f303 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.435835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.436539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.437173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.437558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.438393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.442091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.466155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 970/1950] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:30.472212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.498207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3139d-db8e-4c46-b601-7caa5b4ce858 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.500234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.532468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.534074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.534771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.535615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] PATH_INFO: `/v3/projects/71454cad96f943f5b8e8c9879a47e919/users/d764bc12698b4935bb801dc8f7672b41/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.539731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71454cad96f943f5b8e8c9879a47e919, user_id=d764bc12698b4935bb801dc8f7672b41, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.548836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568f6c0-f94b-4dce-881a-deb3ad7d00b2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.573402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 981/1951] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:30 2022] PUT /identity/v3/projects/71454cad96f943f5b8e8c9879a47e919/users/d764bc12698b4935bb801dc8f7672b41/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:30.586785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.590850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.594135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.682324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47810789-ed76-4fdd-b1b4-583089abd123 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.689560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] MFA Rules not processed for user `d764bc12698b4935bb801dc8f7672b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:30.690854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:30.722611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:30.798109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13b49fe0a514ae48ba9883d50179662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.799125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.799495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.799986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.800940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:30.801191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.803145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.818922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 971/1952] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:30.821949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 982/1953] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:30.825010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.850571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd035c2-28d1-4738-bc17-211a0dab77d5 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:30.857789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13b49fe0a514ae48ba9883d50179662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:30.858495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:30.858958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:30.859109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:30.860011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:30.863625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:30.897442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:30.915005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 972/1954] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:30 2022] POST /identity/v3/projects => generated 354 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:30.917183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:31.046373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8216c66-bdd9-421b-a2d8-cf255b6a4eb6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:31.123955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:31.136181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3a7d-1f16-42c0-82cd-752c7f21fe90 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:31.144751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13b49fe0a514ae48ba9883d50179662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:31.145837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:31.146308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:31.146760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:31.148116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:31.148752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:31.152255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:31.187074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 973/1955] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:31.198262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:31.199442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:31.199937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:31.200586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:31.309184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:31.337410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:31.340880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:31.342255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b954-061a-4119-a595-dfbc74a85373 tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:31.362140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13b49fe0a514ae48ba9883d50179662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:31.362726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 983/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:31.372843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:31.373367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:31.373905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] PATH_INFO: `/v3/projects/78ae9f324f514b61b9697464cd81d919` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:31.383630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78ae9f324f514b61b9697464cd81d919)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:31.387917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:31.538008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ae9f324f514b61b9697464cd81d919', 'request_id': 'req-597eb9bf-f564-4541-a778-cafe95d835ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:31.553668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ae9f324f514b61b9697464cd81d919', 'request_id': 'req-597eb9bf-f564-4541-a778-cafe95d835ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:31.577879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ae9f324f514b61b9697464cd81d919', 'request_id': 'req-597eb9bf-f564-4541-a778-cafe95d835ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:31.603348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] The token cache is being invalidate because project 78ae9f324f514b61b9697464cd81d919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:31.603674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:31.604588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-597eb9bf-f564-4541-a778-cafe95d835ba tempest-VolumeQuotaClassesTest-1135365557 tempest-VolumeQuotaClassesTest-1135365557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:31.606472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 974/1957] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:31 2022] DELETE /identity/v3/projects/78ae9f324f514b61b9697464cd81d919 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:32.229088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:32.377895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209ce7e-7e30-4218-bdc5-8ad827777192 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:32.507269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:32.509690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:32.510552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:32.511299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] PATH_INFO: `/v3/users/c26ec0d51fa340868ae949dbcf36505d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:32.515069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26ec0d51fa340868ae949dbcf36505d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:32.519781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:32.574524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:32.617019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26ec0d51fa340868ae949dbcf36505d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:32.636748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26ec0d51fa340868ae949dbcf36505d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:32.663447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26ec0d51fa340868ae949dbcf36505d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:32.664552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26ec0d51fa340868ae949dbcf36505d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:32.682702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26ec0d51fa340868ae949dbcf36505d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:32.705786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 984/1958] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:32 2022] DELETE /identity/v3/users/c26ec0d51fa340868ae949dbcf36505d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:32.713255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:32.714135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:32.714328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:32.729276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:32.755023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:32.756495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:32.853329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 975/1959] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:32.866226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:32.873930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:32.973119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4153-8b78-4136-a679-c3daaaafd050 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:32.979497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:32.980828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:32.980828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:32.980828 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:32.995337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:32.995872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:33.008255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 985/1960] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:33.343590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:33.346038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:33.364666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c859a1-ff7b-4a62-8973-0c66d5c5a7c2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:33.377905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:33.377905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:33.377905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:33.377905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] PATH_INFO: `/v3/users/aca095e79aba4d62b2e348d531dbe0d8` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:33.378388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca095e79aba4d62b2e348d531dbe0d8)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:33.382943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:33.480390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca095e79aba4d62b2e348d531dbe0d8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.526073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca095e79aba4d62b2e348d531dbe0d8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.543824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca095e79aba4d62b2e348d531dbe0d8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.551616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:33.554265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:33.615704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca095e79aba4d62b2e348d531dbe0d8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.628585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afdc8-2684-4d3d-b9c9-4515a1b83851 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:33.630565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1bc6504-2e56-440c-99c9-002bfb036ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca095e79aba4d62b2e348d531dbe0d8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.636940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:33.638962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:33.642347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:33.642797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] PATH_INFO: `/v3/projects/6f15340c21b045c3a95d0fe0f39ebd4d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:33.644383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f15340c21b045c3a95d0fe0f39ebd4d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:33.646903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:33.652353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 976/1961] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:33 2022] DELETE /identity/v3/users/aca095e79aba4d62b2e348d531dbe0d8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:33.658711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:33.659165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:33.659856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:33.697054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:33.698953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:33.720155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f15340c21b045c3a95d0fe0f39ebd4d', 'request_id': 'req-eb08e263-5601-4b9c-b414-7a2923010cac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.730250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f15340c21b045c3a95d0fe0f39ebd4d', 'request_id': 'req-eb08e263-5601-4b9c-b414-7a2923010cac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.743000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f15340c21b045c3a95d0fe0f39ebd4d', 'request_id': 'req-eb08e263-5601-4b9c-b414-7a2923010cac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.765211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] The token cache is being invalidate because project 6f15340c21b045c3a95d0fe0f39ebd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:33.765516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.766547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:33.768763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 986/1962] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:33 2022] DELETE /identity/v3/projects/6f15340c21b045c3a95d0fe0f39ebd4d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:33.774793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:33.781132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:33.823956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:33.839139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 977/1963] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:33.852396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:33.854442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:33.886174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e263-5601-4b9c-b414-7a2923010cac admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:33.895193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:33.900694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:33.901630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:33.901977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:33.902256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] PATH_INFO: `/v3/users/f13b49fe0a514ae48ba9883d50179662` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:33.904822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13b49fe0a514ae48ba9883d50179662)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:33.906845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:33.986650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c63e-7c8e-421e-be60-fea7d5b84559 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:33.993578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:33.994628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:33.995166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:33.995535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:34.017899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13b49fe0a514ae48ba9883d50179662'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:34.040058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13b49fe0a514ae48ba9883d50179662'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:34.049011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:34.057060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:34.071664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13b49fe0a514ae48ba9883d50179662'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:34.073660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13b49fe0a514ae48ba9883d50179662'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:34.088936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13b49fe0a514ae48ba9883d50179662'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:34.106204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 987/1964] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:33 2022] DELETE /identity/v3/users/f13b49fe0a514ae48ba9883d50179662 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:34.115887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 978/1965] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:34.967690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:34.970613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.121039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6691-2abc-471d-baaa-bf9e7aea8022 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:35.126940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:35.128053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.128447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.128824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] PATH_INFO: `/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.130300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d8a7d23a264ccb8e5a65592f5f9c6c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:35.132442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:35.159502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:35.163267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.195813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e7cb-75f3-4629-bcf9-412adf7b259d service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:35.203138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:35.204409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.205303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.205812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] PATH_INFO: `/v3/projects/a7843ef21a444a0fa76b061c2b91c0ad` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.208392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7843ef21a444a0fa76b061c2b91c0ad)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:35.212302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:35.234170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:35.236434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'request_id': 'req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.252334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'request_id': 'req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.268513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d8a7d23a264ccb8e5a65592f5f9c6c', 'request_id': 'req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.292268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] The token cache is being invalidate because project 41d8a7d23a264ccb8e5a65592f5f9c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:35.292589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.293386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-067f4ad9-9e8d-4281-8cfd-ecc6a3bcc46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.295158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 988/1966] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:34 2022] DELETE /identity/v3/projects/41d8a7d23a264ccb8e5a65592f5f9c6c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:35.301086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517bb5-b011-4196-813e-0c32a6e6b79d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.301509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517bb5-b011-4196-813e-0c32a6e6b79d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.301884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517bb5-b011-4196-813e-0c32a6e6b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.329104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7843ef21a444a0fa76b061c2b91c0ad', 'request_id': 'req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.337855 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7843ef21a444a0fa76b061c2b91c0ad', 'request_id': 'req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.352898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7843ef21a444a0fa76b061c2b91c0ad', 'request_id': 'req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.368673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d4517bb5-b011-4196-813e-0c32a6e6b79d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:35.372864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d4517bb5-b011-4196-813e-0c32a6e6b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.379005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] The token cache is being invalidate because project a7843ef21a444a0fa76b061c2b91c0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:35.379526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.380869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.384654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 979/1967] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:35 2022] DELETE /identity/v3/projects/a7843ef21a444a0fa76b061c2b91c0ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:35.390610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:35.401845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.531443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 989/1968] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:35.535232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aee00-76ae-4050-bf5c-b43161fc7cf3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:35.539169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.539528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.539712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.553180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:35.555137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.555422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.555698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] PATH_INFO: `/v3/users/124817c7d64743d795134df2c02aa167` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.569162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124817c7d64743d795134df2c02aa167)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:35.571154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:35.597478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:35.598933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.628072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 990/1969] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:35.632055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:35.652232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b3c6a-98f1-4820-b1c3-355b56b4542d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:35.665481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:35.666536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.666825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.669908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.671888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:35.672268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:35.676384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:35.700761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:35.704353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124817c7d64743d795134df2c02aa167'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.710309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 991/1970] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:35.710309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:35.713245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.734507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124817c7d64743d795134df2c02aa167'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.745532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd5c22-62b2-4556-8411-29babcedb323 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:35.748189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124817c7d64743d795134df2c02aa167'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.759288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:35.760351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.760576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.760849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] PATH_INFO: `/v3/users/4e208f6be49c49a48d222b932e3710e0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.761863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124817c7d64743d795134df2c02aa167'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.762638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e208f6be49c49a48d222b932e3710e0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:35.763045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124817c7d64743d795134df2c02aa167'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.765216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:35.772871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 980/1971] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:35 2022] DELETE /identity/v3/users/124817c7d64743d795134df2c02aa167 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:35.774268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:35.777273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.852870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e208f6be49c49a48d222b932e3710e0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.863856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e208f6be49c49a48d222b932e3710e0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.883626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e208f6be49c49a48d222b932e3710e0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.885127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e208f6be49c49a48d222b932e3710e0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.901110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1bd8ae5-f07f-49ce-992b-4b5f044148cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e208f6be49c49a48d222b932e3710e0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:35.913420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 992/1972] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:35 2022] DELETE /identity/v3/users/4e208f6be49c49a48d222b932e3710e0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:35.919923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:35.920310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:35.920656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:35.961315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:35.962645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:35.976200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39dc5-5fc8-4e7d-a389-1da053cd5691 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.034952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:36.137327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.138101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.138408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.138751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.142809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.144996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.160848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 993/1973] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:36.176911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.182445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.208454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 981/1974] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:36.213324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.220304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.268129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1e330-5ba0-4cc6-a1e8-e65352a9a9a6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.335954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.336662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.337082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.337357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.343670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:36.349628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.351409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.353867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5975-013c-4ba0-b731-ce8df516f24e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.366872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 994/1975] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:36.375383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.377697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.378109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.378398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.379374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.383363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.435721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 982/1976] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:36 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:36.442146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.460177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863560b-e603-4d04-aa0b-2a1ca0c3138b service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.460548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.462500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.468844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.469982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.470677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.471202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.472316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.474670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.479082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df6af-97e2-46c7-bf3b-297b02f852d6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.485403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.486616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.486911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.487191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] PATH_INFO: `/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.488935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ba36e45a6e4047b0aa6ed3e480ba6b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.495581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.495860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 995/1977] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:36.498711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.539842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b55-1ecb-4f3b-b9a0-bcc58fc48c8d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.550366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.550965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.551246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.551517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.552289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.555169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.569427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 996/1978] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:36.573737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.586629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ddc91-df25-4f44-9fc9-782af43a27b9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.592885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ba36e45a6e4047b0aa6ed3e480ba6b', 'request_id': 'req-cfc3505c-e2a6-4539-91f5-8860472e7508'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:36.608798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ba36e45a6e4047b0aa6ed3e480ba6b', 'request_id': 'req-cfc3505c-e2a6-4539-91f5-8860472e7508'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:36.618214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ba36e45a6e4047b0aa6ed3e480ba6b', 'request_id': 'req-cfc3505c-e2a6-4539-91f5-8860472e7508'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:36.645817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] The token cache is being invalidate because project 50ba36e45a6e4047b0aa6ed3e480ba6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:36.646466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:36.647615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cfc3505c-e2a6-4539-91f5-8860472e7508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:36.649983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 983/1979] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:36 2022] DELETE /identity/v3/projects/50ba36e45a6e4047b0aa6ed3e480ba6b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:36.654896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb1a8-522d-45c1-80f4-0fa786d85000 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.655190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb1a8-522d-45c1-80f4-0fa786d85000 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.655470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb1a8-522d-45c1-80f4-0fa786d85000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.678262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.683539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-658bb1a8-522d-45c1-80f4-0fa786d85000 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:36.685607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-658bb1a8-522d-45c1-80f4-0fa786d85000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.690835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.697083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.697456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] PATH_INFO: `/v3/projects/10132b0ade264f3b878d2bd640571103/users/42408f6aa146473b81fbc9459208d113/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.707739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 984/1980] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:36.715806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.716344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.716754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.723230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:36.729910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10132b0ade264f3b878d2bd640571103, user_id=42408f6aa146473b81fbc9459208d113, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.733059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0afad4-dfb4-42ac-b678-58cb4690f8b0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.751723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:36.753036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.760625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 997/1981] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:36 2022] PUT /identity/v3/projects/10132b0ade264f3b878d2bd640571103/users/42408f6aa146473b81fbc9459208d113/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:36.779168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.779168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.779549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.815277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] MFA Rules not processed for user `42408f6aa146473b81fbc9459208d113`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:36.816801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.869531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 985/1982] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:36.876553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.897530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43b5f-62af-4f4c-88cf-9a9a705b333b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.906890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.908083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.908574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.909072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.910840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:36.911058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.914246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:36.931505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 998/1983] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:36.942177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 986/1984] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:36.943366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.945010 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:36.948477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:36.971751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbdda-9bd3-436b-8dc0-b7bd00285b90 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:36.980658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:36.981875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:36.982366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:36.982848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:36.984331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:36.989053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.030269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:37.035187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc227db3-fe06-4ef3-a41e-b7a0cc2b8d23 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.036552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 999/1985] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:36 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:37.041570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.144178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.144993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.145360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.146610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.147432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c09d-0373-4583-84a6-deb28cfaaf82 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.152637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.153341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.153659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.153969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.155568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.157609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.193697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1000/1986] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:37 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:37.196508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.199648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.223116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82950-f6e7-467d-9b58-172dda6a0db0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.224306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.225831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.235290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.237560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 987/1987] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:37.238470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.247413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.248219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.248903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] PATH_INFO: `/v3/projects/aa3f47398e1f4613a634203523d7724a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.250799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2bfe-62ee-483f-9b31-0ec6336d8a09 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.254394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3f47398e1f4613a634203523d7724a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.256876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.258419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.258619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.258744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.259130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.259972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.262586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.282899 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 988/1988] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:37.284357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.286620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.307781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3429b-1655-4235-ba56-584f3ea3d422 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.315530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.316522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.317035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.318110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] PATH_INFO: `/v3/users/42408f6aa146473b81fbc9459208d113` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.319785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42408f6aa146473b81fbc9459208d113)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.321806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.334160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:37.342136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3f47398e1f4613a634203523d7724a', 'request_id': 'req-5914cf9c-0b12-4bbd-80df-d24231085a41'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.352401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3f47398e1f4613a634203523d7724a', 'request_id': 'req-5914cf9c-0b12-4bbd-80df-d24231085a41'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.364580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3f47398e1f4613a634203523d7724a', 'request_id': 'req-5914cf9c-0b12-4bbd-80df-d24231085a41'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.381943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] The token cache is being invalidate because project aa3f47398e1f4613a634203523d7724a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:37.382329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.383210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.385313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1001/1989] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:37 2022] DELETE /identity/v3/projects/aa3f47398e1f4613a634203523d7724a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:37.386472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.388639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.393399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42408f6aa146473b81fbc9459208d113'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.409769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42408f6aa146473b81fbc9459208d113'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.418746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42408f6aa146473b81fbc9459208d113'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.429526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42408f6aa146473b81fbc9459208d113'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.430577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42408f6aa146473b81fbc9459208d113'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.438344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 989/1990] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:37 2022] DELETE /identity/v3/users/42408f6aa146473b81fbc9459208d113 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:37.440950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.445418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.476335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:37.482746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf9c-0b12-4bbd-80df-d24231085a41 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.544948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674e73-b4f2-4c68-b66b-b4610a29da38 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.551475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.554293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.554754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.555209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] PATH_INFO: `/v3/users/d764bc12698b4935bb801dc8f7672b41` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.557465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d764bc12698b4935bb801dc8f7672b41)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.561194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.575776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.576557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.576843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.577117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.577869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.579859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92ec1-87ff-4974-99de-8d7b6362d1ac admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.598049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1002/1991] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:37.599355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f87e-347e-4595-9978-cc321976892f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.599745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f87e-347e-4595-9978-cc321976892f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.599905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403f87e-347e-4595-9978-cc321976892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.625665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2403f87e-347e-4595-9978-cc321976892f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:37.627477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2403f87e-347e-4595-9978-cc321976892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.637036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1003/1992] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:37.637762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403f87e-347e-4595-9978-cc321976892f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.639816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2403f87e-347e-4595-9978-cc321976892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.654465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403f87e-347e-4595-9978-cc321976892f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.659670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.660672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.660953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.661231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] PATH_INFO: `/v3/projects/2bf9b21cebe04c038bcbe1ebeadbf9cf/users/95cd4911111549d299547c4fb5311639/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.662569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd764bc12698b4935bb801dc8f7672b41'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.681913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf9b21cebe04c038bcbe1ebeadbf9cf, user_id=95cd4911111549d299547c4fb5311639, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:37.685417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd764bc12698b4935bb801dc8f7672b41'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.685610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:37.699944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd764bc12698b4935bb801dc8f7672b41'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.706143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1004/1993] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:37 2022] PUT /identity/v3/projects/2bf9b21cebe04c038bcbe1ebeadbf9cf/users/95cd4911111549d299547c4fb5311639/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:37.707385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.709330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.717320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd764bc12698b4935bb801dc8f7672b41'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.718677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7e647418-fca8-4088-bae5-2204cfd6bdcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd764bc12698b4935bb801dc8f7672b41'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:37.731876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 990/1994] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:37 2022] DELETE /identity/v3/users/d764bc12698b4935bb801dc8f7672b41 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:37.735497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.736245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.736744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.771409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:37.787973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5891-9c44-4cc0-8e61-adc814b5817d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:37.789932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] MFA Rules not processed for user `95cd4911111549d299547c4fb5311639`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:37.792230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.871253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:37.872116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:37.872537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:37.872866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:37.894175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:37.940342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 991/1995] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:37.945890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:37.947695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.008536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:38.061673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.065089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.085017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167c33-66c2-402d-af64-a2a1ecaa80af None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.089448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1005/1996] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:38.090459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.091300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.091660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.092062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.092865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.095748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.145662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 992/1997] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:37 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:38.148088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.172334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c041de-e495-49dc-b45c-9bdeacd820f3 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.216309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.220604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.304242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.305600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.306131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.306656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.307619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.311366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.347265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1e34-b2a7-4f3c-8c88-92520746e6ed admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.360537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.362277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.362778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.363230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] PATH_INFO: `/v3/projects/71454cad96f943f5b8e8c9879a47e919` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.365669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1006/1998] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:38.366188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=71454cad96f943f5b8e8c9879a47e919)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.367309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.370373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.392433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab32f-d64b-418c-af62-2a5707858f51 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.403403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.404536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.405369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.405741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.407134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.410543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.433712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1007/1999] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:38.440916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.469314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48927b-0c64-42c1-a43f-d8d2e7c542ef admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.497390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71454cad96f943f5b8e8c9879a47e919', 'request_id': 'req-a78a0c81-2188-4ec4-b091-40a2516814ca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.515066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71454cad96f943f5b8e8c9879a47e919', 'request_id': 'req-a78a0c81-2188-4ec4-b091-40a2516814ca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.522138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:38.530936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71454cad96f943f5b8e8c9879a47e919', 'request_id': 'req-a78a0c81-2188-4ec4-b091-40a2516814ca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.553906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] The token cache is being invalidate because project 71454cad96f943f5b8e8c9879a47e919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:38.554264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.555193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a78a0c81-2188-4ec4-b091-40a2516814ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.557914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 993/2000] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:38 2022] DELETE /identity/v3/projects/71454cad96f943f5b8e8c9879a47e919 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:38.566676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.566951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.567375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.591962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:38.593582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.599111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.601237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.601237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.601650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] PATH_INFO: `/v3/projects/d3b1c49ae6f94c918aab76b892c76db1/users/defd61c79d5943639daacd9283f287b4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.605127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 994/2001] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:38.614212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.616966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.634933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f00e0-797b-4f62-be3b-813bcb7642f5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.649060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.650809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.651370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.651873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] PATH_INFO: `/v3/projects/10132b0ade264f3b878d2bd640571103` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.655359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10132b0ade264f3b878d2bd640571103)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.659636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b1c49ae6f94c918aab76b892c76db1, user_id=defd61c79d5943639daacd9283f287b4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.662140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.670783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3f765-6fcc-4c2a-9cb2-ffd52186dba1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.690048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1008/2002] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:38 2022] PUT /identity/v3/projects/d3b1c49ae6f94c918aab76b892c76db1/users/defd61c79d5943639daacd9283f287b4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:38.692223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85970c2-5840-47f4-95b2-009560d88287 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.692223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85970c2-5840-47f4-95b2-009560d88287 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.692609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85970c2-5840-47f4-95b2-009560d88287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.722619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:38.728331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b85970c2-5840-47f4-95b2-009560d88287 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:38.729613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b85970c2-5840-47f4-95b2-009560d88287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.741064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10132b0ade264f3b878d2bd640571103', 'request_id': 'req-144e30a9-204b-4582-aae7-b9e806f84300'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.750616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10132b0ade264f3b878d2bd640571103', 'request_id': 'req-144e30a9-204b-4582-aae7-b9e806f84300'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.760139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10132b0ade264f3b878d2bd640571103', 'request_id': 'req-144e30a9-204b-4582-aae7-b9e806f84300'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.785489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] The token cache is being invalidate because project 10132b0ade264f3b878d2bd640571103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:38.785940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.787175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:38.792348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 995/2003] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:38 2022] DELETE /identity/v3/projects/10132b0ade264f3b878d2bd640571103 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:38.792348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.792348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.860037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1009/2004] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:38.865906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.866490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.866855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.898250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:38.900725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.909246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e30a9-204b-4582-aae7-b9e806f84300 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.915457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1010/2005] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:38.916855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.923682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.924937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.925460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.926123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.927573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.929250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8a07-95a1-4a75-a9a5-a4de0c19a8c1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.931066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.934479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.935587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.935871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.936179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.936943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:38.937243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.938935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607394a-22ce-4180-b86e-baa94eea37d0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:38.952864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1011/2006] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:38.954311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.954990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.955260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.959087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 996/2007] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:38.960777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:38.981478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024276d-f19e-4c55-b56e-ef205154ca57 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:38.985295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:38.986576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:38.994548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:38.995824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:38.996472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:38.996985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:38.998447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:38.999386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1012/2008] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:39.000874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.002297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.018444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d799-43ca-4d21-a9de-86be1991f2fc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.029488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.031228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.031719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.032266 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] PATH_INFO: `/v3/projects/d3b1c49ae6f94c918aab76b892c76db1/users/defd61c79d5943639daacd9283f287b4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.036935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b1c49ae6f94c918aab76b892c76db1, user_id=defd61c79d5943639daacd9283f287b4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.042588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.057184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 997/2009] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:38 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:39.058954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.064034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1013/2010] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:38 2022] PUT /identity/v3/projects/d3b1c49ae6f94c918aab76b892c76db1/users/defd61c79d5943639daacd9283f287b4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:39.066038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.158324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583674e0-14e3-44e9-b1e1-5d5a6614b9a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.164328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.165044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.165333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.165613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.166419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:39.166724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.168461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44336-21c6-459b-a6ad-097497364ea3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.184404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 998/2011] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:39.186451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.186747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.187088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.212357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1709aa8-4f20-46ce-9669-08a37d5298e0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.218366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.219108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.219392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.219668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.220429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.222456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.230598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] MFA Rules not processed for user `defd61c79d5943639daacd9283f287b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:39.233792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:39.249454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:39.264676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1014/2012] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:39 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:39.266152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.267334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:39.279825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdffd9-0ac5-4d80-8ba4-502ef1bfe27e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.287527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.288529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.288884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.289228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.290022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.292352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.328232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1015/2013] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:39 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:39.329275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.379111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 999/2014] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:39.381803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.397174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3519db-4acd-413b-b55f-f31f0b855134 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.430826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda453de-cbd9-447d-986f-5637d11c3dc9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.436736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.437444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.437729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.438007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.438764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.440463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.460591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1016/2015] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:39.460591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.460591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:39.478290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.478979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.479649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.479649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.480289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.482383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.506925 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1000/2016] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:39 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:39.509977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.519873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4540013-1e25-4f92-b143-aa9b2139eab4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.525445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.527369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.527701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.528314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.529725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.531419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.543559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1001/2017] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:39.545394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.552590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce6e4e-2332-4c70-ada7-36ac515dd4f5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.559979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.561185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.561766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.562055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.565075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:39.565742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf92d-151f-4549-8181-5a40e5ee37bd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.573566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.574706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.575190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.576708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.577751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.580426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.599653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1002/2018] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:39.599653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.611130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c373e4c-1b02-4286-96f4-c8d02cf5cd79 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.618558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.619280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.619680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.620163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] PATH_INFO: `/v3/projects/448b05bacce2486aa8369a5865abfd75/users/7bdf45e46b4d4512b5679425acb133fa/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.651006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b05bacce2486aa8369a5865abfd75, user_id=7bdf45e46b4d4512b5679425acb133fa, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.653888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.673974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.676904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36c389-e35b-4607-a69e-297829315387 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.677499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1003/2019] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:39 2022] PUT /identity/v3/projects/448b05bacce2486aa8369a5865abfd75/users/7bdf45e46b4d4512b5679425acb133fa/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:39.678585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.703035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1017/2020] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:39.705625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.706092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.706703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.763421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] MFA Rules not processed for user `7bdf45e46b4d4512b5679425acb133fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:39.766473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:39.788760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:39.797779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7113542-a1ab-46f3-894f-fb01f74bc5b9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.806385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:39.806683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.807382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.807672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.807970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.809021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.811117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.837011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1004/2021] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:39.844936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.874305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645611b-831a-4017-9e3e-ce0b49864275 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.882856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.884637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.885130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.885612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] PATH_INFO: `/v3/projects/0e65c0a08412410da4985182da1e58f3/users/53907880693e44e580e6711315f77f38/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.911697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1018/2022] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:39.912875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.914382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:39.930543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c339a2b-b3f9-45e9-bfed-e01cb090bd4e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:39.931375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e65c0a08412410da4985182da1e58f3, user_id=53907880693e44e580e6711315f77f38, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.936759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.943060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:39.945096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:39.945812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:39.946301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] PATH_INFO: `/v3/users/a95936a804054e969786bc5a1a3e0eb0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:39.949912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95936a804054e969786bc5a1a3e0eb0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:39.954209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:39.960307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1005/2023] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:39 2022] PUT /identity/v3/projects/0e65c0a08412410da4985182da1e58f3/users/53907880693e44e580e6711315f77f38/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:39.961499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:39.963685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.083652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95936a804054e969786bc5a1a3e0eb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.085948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bd6f0-f48a-46a4-a092-f864ade65920 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:40.090292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:40.091272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.091773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.092162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.120554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95936a804054e969786bc5a1a3e0eb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.167214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95936a804054e969786bc5a1a3e0eb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.173605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95936a804054e969786bc5a1a3e0eb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.191842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:40.194234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21edb8-c48e-498b-a752-b6efd9572f48 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:40.196751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8e3c81a1-5f69-4f6c-8b7a-47143ab1073c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95936a804054e969786bc5a1a3e0eb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.222352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1006/2024] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:40.222708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1019/2025] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:39 2022] DELETE /identity/v3/users/a95936a804054e969786bc5a1a3e0eb0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:40.224410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.228143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.228527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.228968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.229106 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.229581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.264044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:40.265554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.301656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] MFA Rules not processed for user `53907880693e44e580e6711315f77f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:40.305376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.365441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1020/2026] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:40.378520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:40.380472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.426889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:40.469433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1007/2027] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:40.470244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee148fca-4136-42c8-8a39-9ca326de670d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:40.475407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:40.476586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.477078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.477560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.481472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:40.483026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.498589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:40.501937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:40.514934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:40.523962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1021/2028] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:40.612220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2c57-fa92-4752-b84d-77ab050e308f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:40.620944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:40.622457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.623264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.623813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.643411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:40.646731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5461b3-7525-45a3-b8a5-341988d0488e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:40.671153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1008/2029] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:40.702425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:40.704791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:40.723561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc39bb-339b-4d23-ad2a-539036571107 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:40.743772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:40.748206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.751966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.752435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] PATH_INFO: `/v3/users/53907880693e44e580e6711315f77f38` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.757039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53907880693e44e580e6711315f77f38)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:40.762237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:40.879364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53907880693e44e580e6711315f77f38'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.896032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53907880693e44e580e6711315f77f38'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.918092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53907880693e44e580e6711315f77f38'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.918951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53907880693e44e580e6711315f77f38'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.930302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53907880693e44e580e6711315f77f38'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:40.943611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1022/2030] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:40 2022] DELETE /identity/v3/users/53907880693e44e580e6711315f77f38 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:40.948515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:40.949090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:40.949697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:40.974691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:40.975937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:41.073174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1009/2031] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:41.092894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:41.094977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:41.132804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:41.134929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:41.156382 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3c63a-a1d3-438d-b146-385569dbb3ae None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:41.162559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:41.163526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:41.163814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:41.164335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] PATH_INFO: `/v3/projects/74a0282aeb7a4d9abec32ef7fdbf23e7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:41.166145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a0282aeb7a4d9abec32ef7fdbf23e7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:41.168486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:41.180597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d751fc7-0cf1-46e1-88c6-313d0e82aec4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:41.185620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:41.186493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:41.186650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:41.186861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:41.198457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:41.201908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:41.222831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1023/2032] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:41.250555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a0282aeb7a4d9abec32ef7fdbf23e7', 'request_id': 'req-005a24aa-f56d-4d79-862d-2ca022b88a49'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.264722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a0282aeb7a4d9abec32ef7fdbf23e7', 'request_id': 'req-005a24aa-f56d-4d79-862d-2ca022b88a49'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.279776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a0282aeb7a4d9abec32ef7fdbf23e7', 'request_id': 'req-005a24aa-f56d-4d79-862d-2ca022b88a49'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.321924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] The token cache is being invalidate because project 74a0282aeb7a4d9abec32ef7fdbf23e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:41.322455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.323687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.327000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1010/2033] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:41 2022] DELETE /identity/v3/projects/74a0282aeb7a4d9abec32ef7fdbf23e7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:41.336088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:41.353899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2449cf-c92f-4479-a315-e617b2f8bc1b service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:41.452635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:41.477750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:41.481279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:41.482587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:41.483331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] PATH_INFO: `/v3/users/670b18305d8b497695bfa8f3f7d18ac4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:41.487165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=670b18305d8b497695bfa8f3f7d18ac4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:41.490233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:41.622538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670b18305d8b497695bfa8f3f7d18ac4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.639715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670b18305d8b497695bfa8f3f7d18ac4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.680341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670b18305d8b497695bfa8f3f7d18ac4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.680341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670b18305d8b497695bfa8f3f7d18ac4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.692063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670b18305d8b497695bfa8f3f7d18ac4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:41.706286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1024/2034] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:41 2022] DELETE /identity/v3/users/670b18305d8b497695bfa8f3f7d18ac4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:42.337616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:42.341837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:42.351683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:42.355276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:42.413330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a24aa-f56d-4d79-862d-2ca022b88a49 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:42.567148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:42.645764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:42.647240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:42.647715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:42.648197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] PATH_INFO: `/v3/projects/2a79c6f23df44ee88fad80c8b3665119` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:42.662019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a79c6f23df44ee88fad80c8b3665119)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:42.666253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:42.684374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dba3e7-ef9c-430e-8152-65a9fd6e73dc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:42.721601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:42.723486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:42.724373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:42.725115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] PATH_INFO: `/v3/projects/0e65c0a08412410da4985182da1e58f3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:42.731420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e65c0a08412410da4985182da1e58f3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:42.740857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:42.895844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a79c6f23df44ee88fad80c8b3665119', 'request_id': 'req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.913339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e65c0a08412410da4985182da1e58f3', 'request_id': 'req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.917323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a79c6f23df44ee88fad80c8b3665119', 'request_id': 'req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.927831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e65c0a08412410da4985182da1e58f3', 'request_id': 'req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.937375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a79c6f23df44ee88fad80c8b3665119', 'request_id': 'req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.943944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e65c0a08412410da4985182da1e58f3', 'request_id': 'req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.982039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:42.983499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] The token cache is being invalidate because project 2a79c6f23df44ee88fad80c8b3665119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:42.983979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.986995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a72bac08-ad7d-4c38-bfd6-48a69f8cda4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:42.994743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] The token cache is being invalidate because project 0e65c0a08412410da4985182da1e58f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:42.999123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1011/2035] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:42 2022] DELETE /identity/v3/projects/2a79c6f23df44ee88fad80c8b3665119 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:42.999648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:43.001222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ca15488d-1d15-4e9d-9e96-ca4bf496bfbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:43.002449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2371-691f-47e9-9f8a-e4a9e70c7b9b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.002898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2371-691f-47e9-9f8a-e4a9e70c7b9b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.003341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2371-691f-47e9-9f8a-e4a9e70c7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.010557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1025/2036] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:42 2022] DELETE /identity/v3/projects/0e65c0a08412410da4985182da1e58f3 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:43.015194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4305b-984d-425f-baef-9c51cc410c60 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.015915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4305b-984d-425f-baef-9c51cc410c60 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.017593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4305b-984d-425f-baef-9c51cc410c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.101219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-14a4305b-984d-425f-baef-9c51cc410c60 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:43.102544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6c3b2371-691f-47e9-9f8a-e4a9e70c7b9b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:43.102848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-14a4305b-984d-425f-baef-9c51cc410c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:43.108022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6c3b2371-691f-47e9-9f8a-e4a9e70c7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:43.273520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1026/2037] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:43.285824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d635-559a-4811-9db8-755796c3806b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.286005 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d635-559a-4811-9db8-755796c3806b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.286277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d635-559a-4811-9db8-755796c3806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.311877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1012/2038] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:43.334166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.337190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.343782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.353004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2278d635-559a-4811-9db8-755796c3806b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:43.355192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2278d635-559a-4811-9db8-755796c3806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:43.390927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1027/2039] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:43.403094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d635-559a-4811-9db8-755796c3806b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.416133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:43.417632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:43.437214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d635-559a-4811-9db8-755796c3806b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.440290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1013/2040] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:43.445439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.450527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.452986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.453554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.454030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.462583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:43.463190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.470181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba14d1-dade-48f5-b6af-8ae173df26ab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.470726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.493416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.494336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.494619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.494883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.495617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:43.497544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.499276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.516118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1028/2041] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:43.520340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.541155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1014/2042] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:43.543731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4a31-f1b6-443d-a087-b7d089b04df9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.545557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.558692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738dfe-b257-4ff3-b0ef-145067b31856 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.565072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.566071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.566437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.566836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.567290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.568247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.569738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.570317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.570787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.571408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.576602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.584429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.621528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1015/2043] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:43.631099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.698817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:43.736362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1029/2044] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/projects => generated 359 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:43.748578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.758823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032435-85ec-49d9-b159-f3edb37b6c3a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.851666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a2ad-d299-4678-9963-6a25eb0cd38a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.865761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.867095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.867095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.867418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.868570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.871380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.905184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1030/2045] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/users => generated 280 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:43.912984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:43.942289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922d0b4-836c-4ceb-955c-817c6a081ac9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:43.954974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:43.957147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:43.958139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:43.959054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:43.960816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:43.965718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:43.996612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.003720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.005600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.007795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1031/2046] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:44.008865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.010491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.014773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.031582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.068781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb7e1-11bc-4e77-95d4-a7629d80afd1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.081658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1016/2047] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:43 2022] POST /identity/v3/users => generated 293 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:44.088346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.088566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.089685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.090165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.090645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.092403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.095425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.114577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f62a2-6f4d-462f-810c-a8235de92374 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.129193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1032/2048] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:44.129480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.129480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.129480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.129480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.130062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.132631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.133156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.163198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1017/2049] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:44.163413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50980a9-47cb-4e55-917e-5ec693ff46d1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.165546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.172108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.173781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.174344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.174865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] PATH_INFO: `/v3/projects/a71e1d6a4a26448b94109b591831e5d1/users/2a4d06bcac544cd29eb238b559c742f6/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.188536 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a26a-ba71-4c64-afb2-5fb7a00119d3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.199394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.201128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.201583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.202033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.205965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.209369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.239209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71e1d6a4a26448b94109b591831e5d1, user_id=2a4d06bcac544cd29eb238b559c742f6, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.246399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1018/2050] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:44.246692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2b092-0545-4df4-87ac-7b255a73fe4a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.253701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.266581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a91a1-aeda-48e8-b575-6dfd22416e11 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.277939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:44.293190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.294741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1033/2051] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:44 2022] PUT /identity/v3/projects/a71e1d6a4a26448b94109b591831e5d1/users/2a4d06bcac544cd29eb238b559c742f6/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:44.296231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.296724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.297221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] PATH_INFO: `/v3/projects/f482061d7d114a21b9e8928b34be96e2/users/2d2472dfde4f479db525c35482281404/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.318877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.319257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.319709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.328337 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f482061d7d114a21b9e8928b34be96e2, user_id=2d2472dfde4f479db525c35482281404, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.334402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6671-68e7-498a-9726-76deec29510c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.365278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1019/2052] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:44 2022] PUT /identity/v3/projects/f482061d7d114a21b9e8928b34be96e2/users/2d2472dfde4f479db525c35482281404/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:44.378229 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.379597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.380217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.381980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] MFA Rules not processed for user `2a4d06bcac544cd29eb238b559c742f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:44.383984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:44.418898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] MFA Rules not processed for user `2d2472dfde4f479db525c35482281404`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:44.420481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:44.520936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1034/2053] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:44.532882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1020/2054] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:44.538105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.578633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.579758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:44.601734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:44.655156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd7af0-6b04-42cf-b31c-c8cfade47e79 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.661136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.662005 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.662382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.662750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.663591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.667086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.701897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9141a5-9ee4-493a-bfc9-4fe78dfcc52c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.715457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.721506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.722667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.723358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.733868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1035/2055] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:44 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:44.743114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.744889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.746535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.758768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1021/2056] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:44.788533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.810726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3cea5-b526-4073-b324-c7f298cb4f18 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.839838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19663ca5-31c5-4a12-b2fc-b88644d3139c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.846055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.847527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.847527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.847527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.848076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.850018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.885528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1036/2057] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:44 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:44.890600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.899619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:44.908847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9029-3192-415d-bdad-6b3dec8dade9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:44.915977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.917212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.917691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.918175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.919372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.922010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:44.953778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1037/2058] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:44.960299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:44.963254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:44.964731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:44.969544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:44.970156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] PATH_INFO: `/v3/users/2a4d06bcac544cd29eb238b559c742f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:44.977700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4d06bcac544cd29eb238b559c742f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:44.984507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.005375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b821-c0cd-4a03-84b2-f3d5793bf667 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:45.023082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:45.025273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.026081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.027262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] PATH_INFO: `/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3/users/c1851f3bb19149dc8ca0c59c54648f2b/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.081338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a906cf4b6b47aa80d1ac57055bddf3, user_id=c1851f3bb19149dc8ca0c59c54648f2b, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:45.087433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.123184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1038/2059] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:44 2022] PUT /identity/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3/users/c1851f3bb19149dc8ca0c59c54648f2b/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:45.125637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:45.127024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4d06bcac544cd29eb238b559c742f6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:45.171196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4d06bcac544cd29eb238b559c742f6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:45.197791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4d06bcac544cd29eb238b559c742f6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:45.225022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4d06bcac544cd29eb238b559c742f6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:45.230637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e55112e6-5203-405e-9bd4-7053f2f5d28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4d06bcac544cd29eb238b559c742f6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:45.250113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1022/2060] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:44 2022] DELETE /identity/v3/users/2a4d06bcac544cd29eb238b559c742f6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:45.256709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.257000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.257643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.303818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:45.305298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:45.329054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0583-2bd8-44c2-935d-d43f8c4bc059 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:45.367400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:45.441354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1023/2061] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:45.452624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:45.453102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:45.454124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.454877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.455286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.455383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:45.456577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:45.459670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.481643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1039/2062] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:45.488622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:45.491979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:45.516397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cfc3b-3741-449e-8e18-091114348938 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:45.522953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:45.524130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.524553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.524988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] PATH_INFO: `/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3/users/c1851f3bb19149dc8ca0c59c54648f2b/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.527866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a906cf4b6b47aa80d1ac57055bddf3, user_id=c1851f3bb19149dc8ca0c59c54648f2b, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:45.531507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1075f48-7091-4322-89e7-10e53a22c4b3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.540111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138faa6-0b18-4894-9682-62f8bace537f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:45.547367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1040/2063] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:45 2022] PUT /identity/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3/users/c1851f3bb19149dc8ca0c59c54648f2b/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:45.567971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.568676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.569182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.618027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] MFA Rules not processed for user `c1851f3bb19149dc8ca0c59c54648f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:45.619811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:45.624260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:45.625432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.626108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.626799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.696461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:45.744436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1041/2064] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:45.759345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:45.762833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.764606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:45.767667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:45.782109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1024/2065] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:45.881246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137285-5599-4c75-ae46-92681a751ce6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:45.888848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:45.890370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:45.891086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:45.891775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:45.912603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:45.914705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:45.931130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1042/2066] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:45.971476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:46.018082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79923-7539-404a-82b1-583361ca4473 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:46.029705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:46.031970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:46.032501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:46.033556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] PATH_INFO: `/v3/users/2d2472dfde4f479db525c35482281404` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:46.058116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2472dfde4f479db525c35482281404)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:46.078271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:46.178328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:46.236118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2472dfde4f479db525c35482281404'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.287320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2472dfde4f479db525c35482281404'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.311777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:46.315502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.323238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2472dfde4f479db525c35482281404'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.362514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4343-a30e-45cb-bd91-bb00acf2c399 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:46.374447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:46.376524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2472dfde4f479db525c35482281404'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.377364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:46.377364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:46.377364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] PATH_INFO: `/v3/projects/a71e1d6a4a26448b94109b591831e5d1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:46.381501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71e1d6a4a26448b94109b591831e5d1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:46.387609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:46.388630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f5321370-75f1-4057-8984-639af4e297bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2472dfde4f479db525c35482281404'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.430750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1025/2067] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:45 2022] DELETE /identity/v3/users/2d2472dfde4f479db525c35482281404 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:46.436985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a73b07-7120-4093-b288-b1874ed52e77 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:46.437592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a73b07-7120-4093-b288-b1874ed52e77 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:46.438158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a73b07-7120-4093-b288-b1874ed52e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:46.529861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-06a73b07-7120-4093-b288-b1874ed52e77 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:46.533634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-06a73b07-7120-4093-b288-b1874ed52e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.613823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71e1d6a4a26448b94109b591831e5d1', 'request_id': 'req-73e423cd-84c1-4b2e-866b-c1d957dc8a82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.629351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71e1d6a4a26448b94109b591831e5d1', 'request_id': 'req-73e423cd-84c1-4b2e-866b-c1d957dc8a82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.645629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71e1d6a4a26448b94109b591831e5d1', 'request_id': 'req-73e423cd-84c1-4b2e-866b-c1d957dc8a82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.683456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] The token cache is being invalidate because project a71e1d6a4a26448b94109b591831e5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:46.684180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.686676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:46.689549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1043/2068] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:46 2022] DELETE /identity/v3/projects/a71e1d6a4a26448b94109b591831e5d1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:46.691579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:46.699400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.742318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1026/2069] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:46.744498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:46.744949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:46.745448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:46.776398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:46.778190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.825233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e423cd-84c1-4b2e-866b-c1d957dc8a82 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:46.836761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:46.838258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:46.839759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:46.840257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:46.843759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.863443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1027/2070] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:46.864188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:46.866323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:46.903691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:46.980280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:46.982746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d2d4-fa60-4f4a-a63b-c8148b602834 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.003723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1044/2071] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:47.014638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af090ac-9393-40c7-a9b3-1c26eeb4f0ea None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.019944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.020999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.021388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.021760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.023834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.024924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.025386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.034879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:47.041941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.045093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.076882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1028/2072] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:47.078738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:47.081207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:47.118515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1045/2073] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:47.125980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:47.143916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60246d6a-ca06-4f3f-8dc9-173f85d1a649 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.188383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.192349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.196522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.196973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.198009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:47.202133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.205331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.249780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1029/2074] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:47.262462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:47.303569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac156-f72d-4891-bb34-e511c489ec2e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.338260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.339230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.339649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.340258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.341383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.354928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.462904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1046/2075] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:47 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:47.470098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:47.499806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5b04a-e605-48c5-a57e-9ac64aab6d5b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.677784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.678902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.679393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.679881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.687753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.691607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.773196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1030/2076] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:47 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:47.774581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:47.811392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f181d1-7dcb-46d0-9e55-dbe088cecc94 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.838430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.839661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.839972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.840483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.845473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.854689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:47.926059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1047/2077] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:47.930408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:47.956470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc494a-d31b-4a16-a7a7-a90dcb6df2e3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:47.977563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:47.979701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:47.979701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:47.979701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:47.991338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:47.994519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:48.032191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1031/2078] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:48.036386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:48.054517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbecd8-1daa-4ae9-9b00-21108849834e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:48.067111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:48.068738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:48.069200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:48.069740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] PATH_INFO: `/v3/projects/f1a72d23da2148c598c119821ec8a513/users/101810e54c274bf48c3cab586d24e764/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:48.100376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a72d23da2148c598c119821ec8a513, user_id=101810e54c274bf48c3cab586d24e764, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:48.106202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8821-b0fc-4ead-82d9-7a7c93db1cb0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:48.108049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:48.113050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:48.145662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1048/2079] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:48 2022] PUT /identity/v3/projects/f1a72d23da2148c598c119821ec8a513/users/101810e54c274bf48c3cab586d24e764/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:48.154729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:48.155312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:48.155816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:48.156685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ebb33-4f70-4bb6-a968-d4fdc4ca1e0f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:48.189078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:48.191163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:48.268453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:48.270082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:48.270689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:48.271200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] PATH_INFO: `/v3/projects/f482061d7d114a21b9e8928b34be96e2` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:48.273615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f482061d7d114a21b9e8928b34be96e2)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:48.277036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:48.298687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1049/2080] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:48.313166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:48.372083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f482061d7d114a21b9e8928b34be96e2', 'request_id': 'req-6be5467e-68ed-4014-8627-3d31a30b823e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.381462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f482061d7d114a21b9e8928b34be96e2', 'request_id': 'req-6be5467e-68ed-4014-8627-3d31a30b823e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.388912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:48.390801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f482061d7d114a21b9e8928b34be96e2', 'request_id': 'req-6be5467e-68ed-4014-8627-3d31a30b823e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.394703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf137-8d28-41e7-abed-6b577b06859a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:48.413488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:48.413793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] The token cache is being invalidate because project f482061d7d114a21b9e8928b34be96e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:48.414314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.415482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.418450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1032/2081] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:48 2022] DELETE /identity/v3/projects/f482061d7d114a21b9e8928b34be96e2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:48.424579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:48.426371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:48.475821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:48.475821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:48.475821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:48.475821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:48.476289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:48.523329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5467e-68ed-4014-8627-3d31a30b823e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:48.532371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:48.533741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:48.534431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:48.534709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] PATH_INFO: `/v3/users/c1851f3bb19149dc8ca0c59c54648f2b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:48.536753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1851f3bb19149dc8ca0c59c54648f2b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:48.539888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:48.575632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:48.577706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:48.594888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1050/2082] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:48.627349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1851f3bb19149dc8ca0c59c54648f2b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.644470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1851f3bb19149dc8ca0c59c54648f2b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.655450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1851f3bb19149dc8ca0c59c54648f2b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.665968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1851f3bb19149dc8ca0c59c54648f2b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.667124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7399993e-8eb5-461f-81dc-a316d67963ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1851f3bb19149dc8ca0c59c54648f2b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:48.677903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1033/2083] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:48 2022] DELETE /identity/v3/users/c1851f3bb19149dc8ca0c59c54648f2b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:05:49.195683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:49.214810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8906ff-7bf5-4d79-a871-493b4954a4b4 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:49.346767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:49.348285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.348774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.349243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] PATH_INFO: `/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.352086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a906cf4b6b47aa80d1ac57055bddf3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:49.357426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:49.483604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a906cf4b6b47aa80d1ac57055bddf3', 'request_id': 'req-231eba66-e36f-449b-9614-f42f82a0e028'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:49.498614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a906cf4b6b47aa80d1ac57055bddf3', 'request_id': 'req-231eba66-e36f-449b-9614-f42f82a0e028'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:49.513103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a906cf4b6b47aa80d1ac57055bddf3', 'request_id': 'req-231eba66-e36f-449b-9614-f42f82a0e028'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:49.518318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:49.543188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] The token cache is being invalidate because project 67a906cf4b6b47aa80d1ac57055bddf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:49.543639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:49.544886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-231eba66-e36f-449b-9614-f42f82a0e028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:49.547395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1051/2084] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:49 2022] DELETE /identity/v3/projects/67a906cf4b6b47aa80d1ac57055bddf3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:49.553045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cc47-19e6-478b-9c4d-a6d131e72695 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.553744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cc47-19e6-478b-9c4d-a6d131e72695 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.553744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9cc47-19e6-478b-9c4d-a6d131e72695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.583293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a8c9cc47-19e6-478b-9c4d-a6d131e72695 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:49.585358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a8c9cc47-19e6-478b-9c4d-a6d131e72695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:49.674735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.675378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.675846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.737205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1034/2085] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:49.738475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] MFA Rules not processed for user `101810e54c274bf48c3cab586d24e764`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:49.740575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:49.750383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.751276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.752225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.788099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:49.790898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:49.809772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1035/2086] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:49.818351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:49.826878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:49.839160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4198b-3057-4d7a-8379-ebcb473bdd37 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:49.852650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:49.853781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.854269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.854679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.855835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:49.856396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:49.861247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:49.874963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1052/2087] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:49.886153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1036/2088] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:05:49.889536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:49.891326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:49.892223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:49.903918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cff307-ef66-40ed-b01e-b0db93906f9e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:49.911747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:49.912829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:49.913166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:49.913625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:49.914845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:49.918560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:49.970337 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1037/2089] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:49 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:05:49.977981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:49.991684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4ccef-aa42-465f-94aa-4ba1b043ac03 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.078794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5feab-7185-4d29-baab-c498eea8193c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.086471 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.087302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.087623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.088118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.088880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.089516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.090317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.090779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.091242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.092240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.133586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1038/2090] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:49 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:50.136147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.152960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03b42-8965-42ef-8f73-de8d82a92337 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.162550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.163732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.164291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.164745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.166271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.169909 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.180669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:50.181612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1039/2091] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:50.187233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.187893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.190442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.199161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95387fdd-bc74-4618-8e21-ba671b8602f8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.207437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1053/2092] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:50.221661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.222702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.222968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.223332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.224540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.227381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c1b4-2ef8-48c0-83ad-fb85b0b05d77 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.249457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1040/2093] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:50.256736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.276843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e97f-70f7-43c5-a800-fb0c132d73b2 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.282119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.283481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.283765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.284073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] PATH_INFO: `/v3/projects/59d4f3f5a0f340a3a745954523fefa45/users/3dd5e3850d4f405b8df98cb28c41c154/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.306173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d4f3f5a0f340a3a745954523fefa45, user_id=3dd5e3850d4f405b8df98cb28c41c154, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.311522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.337486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1054/2094] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:50 2022] PUT /identity/v3/projects/59d4f3f5a0f340a3a745954523fefa45/users/3dd5e3850d4f405b8df98cb28c41c154/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:50.357021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.357593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.358063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.406146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] MFA Rules not processed for user `3dd5e3850d4f405b8df98cb28c41c154`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:50.408337 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:50.516679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1041/2095] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:50.521711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.645430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f19-e5c1-4f85-8cc8-d7d1d4f1893e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.656935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.658173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.658436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.658698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.660792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.664599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.713179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1055/2096] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:50 2022] POST /identity/v3/projects => generated 391 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:50.720107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.745080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501aa3-b33b-464b-96d6-28dd25376b6c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.779620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:50.851884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.852619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.852785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.853059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.853771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.855747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.888324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1042/2097] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:50 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:50.891836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.912525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe5df-fb44-48e7-a886-89e8d8032a95 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.919855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.921082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.921544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.921935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:50.922897 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:50.925538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:50.952484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1056/2098] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:05:50.952810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:50.974737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281b4ba-e107-4370-8e69-eafe10fb886c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:50.982938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:50.984706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:50.985270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:50.985837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] PATH_INFO: `/v3/projects/3bbb856e9b384bee8ac22947ebd08d11/users/1e30fbf06078414e8a40e1ff4b9a5f7e/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.025805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbb856e9b384bee8ac22947ebd08d11, user_id=1e30fbf06078414e8a40e1ff4b9a5f7e, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:51.032356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:51.052049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1043/2099] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:50 2022] PUT /identity/v3/projects/3bbb856e9b384bee8ac22947ebd08d11/users/1e30fbf06078414e8a40e1ff4b9a5f7e/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:51.056203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:51.070027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace639-29bd-4528-aa6c-0fb56533f35c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:51.154399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:51.155582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.156146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.156676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.158269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:51.161383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129eeed-6a72-482f-bc52-d3870deb30ca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:51.178694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1057/2100] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:51.184712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:51.204065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab497935-f4a6-41e6-b16b-9c1df89ade6c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:51.211263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:51.212213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.212507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.212779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] PATH_INFO: `/v3/projects/3bbb856e9b384bee8ac22947ebd08d11/users/1e30fbf06078414e8a40e1ff4b9a5f7e/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.215285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbb856e9b384bee8ac22947ebd08d11, user_id=1e30fbf06078414e8a40e1ff4b9a5f7e, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:51.218090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:51.232847 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1044/2101] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:51 2022] PUT /identity/v3/projects/3bbb856e9b384bee8ac22947ebd08d11/users/1e30fbf06078414e8a40e1ff4b9a5f7e/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:51.246332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.246958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.247471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.282211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] MFA Rules not processed for user `1e30fbf06078414e8a40e1ff4b9a5f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:51.283895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:51.334273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:51.410155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1058/2102] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:51.422310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:51.496604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552a25-cd55-4676-8101-fb0c6f166d8c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:51.501786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:51.502474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.502735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.503014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.514410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:51.516983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be64ef3-d3ee-42b9-9e5d-4810a2199a84 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:51.534984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1045/2103] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:51.626019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:51.627687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:51.643261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15c3a-381d-4374-b439-950443d98d71 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:51.647254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:51.647935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.648257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.648536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.724689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:51.726331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6829b5-fdd7-44c8-9bb6-a3bb61a2a940 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:51.738772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1059/2104] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:05:51.913997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff07-90e0-4b50-8f5e-8faec5126310 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:51.916923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff07-90e0-4b50-8f5e-8faec5126310 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:51.919034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff07-90e0-4b50-8f5e-8faec5126310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:51.960655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f19aff07-90e0-4b50-8f5e-8faec5126310 None None] MFA Rules not processed for user `101810e54c274bf48c3cab586d24e764`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:51.962659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f19aff07-90e0-4b50-8f5e-8faec5126310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:52.062511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1046/2105] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:53.533337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:53.534284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:53.534889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:53.537561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1060/2106] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:05:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:05:53.572743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:53.573709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:53.574358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:53.617467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] MFA Rules not processed for user `18b00832e92241ee803efdb173c94f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:53.619659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:53.661417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:53.672080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:53.714458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:53.806804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa2332-ed38-498f-97cd-1cde831aa7c4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:53.816495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:53.818195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:53.818701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:53.819414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] PATH_INFO: `/v3/users/39d92849843e49e7833f03ca38cb8367` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:53.822523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d92849843e49e7833f03ca38cb8367)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:53.826599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:53.844053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1047/2107] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:53.854600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:53.857988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:53.883180 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f00b4-c86c-4b79-9c2f-ec5a33bafc1e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:53.900061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:53.902223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:53.903218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:53.904036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:53.917001 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:53.919094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:53.931187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1048/2108] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:05:53.939449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d92849843e49e7833f03ca38cb8367'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:53.953661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d92849843e49e7833f03ca38cb8367'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:53.973085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:53.987976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d92849843e49e7833f03ca38cb8367'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:53.989421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d92849843e49e7833f03ca38cb8367'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.001690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-054f2b12-aee0-45bc-838e-71703ba032cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d92849843e49e7833f03ca38cb8367'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.011567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1061/2109] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:05:53 2022] DELETE /identity/v3/users/39d92849843e49e7833f03ca38cb8367 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:54.341338 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:54.356312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990d598-c29b-4bc7-868e-1ac8a20f188c service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:54.441903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:54.442804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:54.443084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:54.443354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] PATH_INFO: `/v3/projects/cdd447d1ebbf403bbf62efc88834bdca` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:54.444711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd447d1ebbf403bbf62efc88834bdca)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:54.446726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:54.522660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd447d1ebbf403bbf62efc88834bdca', 'request_id': 'req-7fe29ca0-3c03-4378-9309-baf7238bac1c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.529719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd447d1ebbf403bbf62efc88834bdca', 'request_id': 'req-7fe29ca0-3c03-4378-9309-baf7238bac1c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.536376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd447d1ebbf403bbf62efc88834bdca', 'request_id': 'req-7fe29ca0-3c03-4378-9309-baf7238bac1c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.552645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] The token cache is being invalidate because project cdd447d1ebbf403bbf62efc88834bdca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:05:54.552894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.553501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fe29ca0-3c03-4378-9309-baf7238bac1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:05:54.555099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1049/2110] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:05:54 2022] DELETE /identity/v3/projects/cdd447d1ebbf403bbf62efc88834bdca => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:54.562177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:54.562660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:54.564286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:54.595346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:54.597606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:54.714123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1062/2111] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:54.732726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:54.734772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:54.739828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:54.806351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:54.808818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:54.823968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1050/2112] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:05:54.836275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:54.850510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500fe1-60d5-4433-9571-0340f51e3021 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:54.860556 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:54.861759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:54.862262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:54.862789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:54.864192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:05:54.864728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:54.867757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:54.891435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1063/2113] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:05:54.898501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:54.915367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c2e93-6601-4da4-a67e-ffb34f3a55c1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:54.923886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:54.925032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:54.925472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:54.925826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:54.927098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:54.930861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:54.973255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1051/2114] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:05:54 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:54.978262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:54.990017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5eb8e-ed4b-4db5-b34b-6267fabc2d54 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:55.071084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:55.072251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.072709 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.073169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.074332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:55.078002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:55.105392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1064/2115] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:05:54 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:05:55.110820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:55.123308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e927fe-0da3-41c3-be6d-6e6d50325f3a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:55.128470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:55.129202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.129538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.129938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.130848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:55.132996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:55.135856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:55.148832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1052/2116] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:55.153315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:55.168691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16c02-f7ff-43d7-8b66-364ab0dfcdc1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:55.176314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:55.177637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.178198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.178574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.179641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:55.182581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83127539-d472-4525-af61-2edada948ce3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:55.202060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1065/2117] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:05:55.209241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:55.224431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d707aaf-bd89-4978-aec5-919a062a8a3b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:55.230537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:55.231978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.232310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.232607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] PATH_INFO: `/v3/projects/f0246519bc2240cf8d1ba54172c0faca/users/ab9da673f40b4e3eb541fdc380cfe282/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.265452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0246519bc2240cf8d1ba54172c0faca, user_id=ab9da673f40b4e3eb541fdc380cfe282, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:55.271467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:55.303239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1053/2118] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:05:55 2022] PUT /identity/v3/projects/f0246519bc2240cf8d1ba54172c0faca/users/ab9da673f40b4e3eb541fdc380cfe282/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:05:55.308330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7d9e-355d-4967-916c-13907caab356 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.308607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7d9e-355d-4967-916c-13907caab356 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.309076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7d9e-355d-4967-916c-13907caab356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.341711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-66eb7d9e-355d-4967-916c-13907caab356 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:05:55.343883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-66eb7d9e-355d-4967-916c-13907caab356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:55.425534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:55.448733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1066/2119] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:05:55.460211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:05:55.462916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:05:55.554128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514779c-00a3-40de-8252-267faf9b4c34 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:05:55.558246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:05:55.558960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:05:55.559386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:05:55.559637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:05:55.570644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:05:55.572227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34987c-88cf-4c64-89fe-677b6be50e89 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:05:55.584395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1054/2120] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:00.988740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:00.989359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:00.989359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:01.025407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] MFA Rules not processed for user `ab9da673f40b4e3eb541fdc380cfe282`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:01.026677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:01.132515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1067/2121] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:01.150947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcdb4-220d-46ff-aeeb-3b47941fa1ec None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:01.151542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcdb4-220d-46ff-aeeb-3b47941fa1ec None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:01.151962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcdb4-220d-46ff-aeeb-3b47941fa1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:01.183048 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c24dcdb4-220d-46ff-aeeb-3b47941fa1ec None None] MFA Rules not processed for user `ab9da673f40b4e3eb541fdc380cfe282`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:01.185214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c24dcdb4-220d-46ff-aeeb-3b47941fa1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:01.202824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1055/2122] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:01.216956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:01.218506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:01.326650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafd8f9-e3b0-43c2-8adc-69b21955d92d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:01.336585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:01.337271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:01.337551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:01.337824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:01.347201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:01.348891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:01.361022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1068/2123] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:02.573696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec76c8-a006-4a93-a7e4-2e502234e870 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:02.576585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec76c8-a006-4a93-a7e4-2e502234e870 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:02.577453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec76c8-a006-4a93-a7e4-2e502234e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:02.615169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3dec76c8-a006-4a93-a7e4-2e502234e870 None None] MFA Rules not processed for user `ab9da673f40b4e3eb541fdc380cfe282`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:02.618397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3dec76c8-a006-4a93-a7e4-2e502234e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:02.641508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1056/2124] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:02.686345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:02.694627 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:02.754873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b266-a039-4551-bb29-72ad9f719126 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:02.777605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:02.779156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:02.779662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:02.779771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] PATH_INFO: `/v3/users/3dd5e3850d4f405b8df98cb28c41c154` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:02.796550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd5e3850d4f405b8df98cb28c41c154)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:02.798592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:02.994630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd5e3850d4f405b8df98cb28c41c154'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:03.027223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd5e3850d4f405b8df98cb28c41c154'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:03.031714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:03.096062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd5e3850d4f405b8df98cb28c41c154'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:03.097328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd5e3850d4f405b8df98cb28c41c154'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:03.121372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd5e3850d4f405b8df98cb28c41c154'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:03.162892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:03.163171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:03.163445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:03.165514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1069/2125] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:02 2022] DELETE /identity/v3/users/3dd5e3850d4f405b8df98cb28c41c154 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:03.222146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:03.226611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:03.438573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1057/2126] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:03.481727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:03.494512 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:03.724258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcd34-7aa3-4153-8a50-b1136341d488 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:03.736037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:03.738136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:03.739562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:03.740816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:03.769545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:03.775271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:03.821910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1070/2127] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:04.718085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:04.720193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:04.754215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf43539-241b-4e70-91a9-8d4c10239d9b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:04.780502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:04.782810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:04.783691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:04.784484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] PATH_INFO: `/v3/projects/59d4f3f5a0f340a3a745954523fefa45` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:04.787710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d4f3f5a0f340a3a745954523fefa45)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:04.790629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:04.909683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d4f3f5a0f340a3a745954523fefa45', 'request_id': 'req-080708dd-8a80-4125-a723-cc9cd67d56ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:04.920555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d4f3f5a0f340a3a745954523fefa45', 'request_id': 'req-080708dd-8a80-4125-a723-cc9cd67d56ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:04.930727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:04.934704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d4f3f5a0f340a3a745954523fefa45', 'request_id': 'req-080708dd-8a80-4125-a723-cc9cd67d56ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:04.967194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] The token cache is being invalidate because project 59d4f3f5a0f340a3a745954523fefa45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:04.969157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:04.970643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:04.980747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1058/2128] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:04 2022] DELETE /identity/v3/projects/59d4f3f5a0f340a3a745954523fefa45 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:04.981109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:04.997545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7844-c484-4e0a-b31b-80636c7d6153 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:05.177004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:05.178553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:05.179049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:05.179499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] PATH_INFO: `/v3/users/1e30fbf06078414e8a40e1ff4b9a5f7e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:05.185064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e30fbf06078414e8a40e1ff4b9a5f7e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:05.197363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:05.292107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:05.294256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:05.310833 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080708dd-8a80-4125-a723-cc9cd67d56ae admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:05.311026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e30fbf06078414e8a40e1ff4b9a5f7e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.317479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:05.318445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:05.318733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:05.319017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] PATH_INFO: `/v3/users/4ca30ffbc2b84785a0b56d0596ed81d7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:05.320411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca30ffbc2b84785a0b56d0596ed81d7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:05.322610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:05.330671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e30fbf06078414e8a40e1ff4b9a5f7e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.400923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e30fbf06078414e8a40e1ff4b9a5f7e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.412575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca30ffbc2b84785a0b56d0596ed81d7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.421051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e30fbf06078414e8a40e1ff4b9a5f7e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.445801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d1775036-e1f0-430b-bd63-cea242c0e388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e30fbf06078414e8a40e1ff4b9a5f7e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.458206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:05.462133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca30ffbc2b84785a0b56d0596ed81d7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.486204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1071/2129] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:04 2022] DELETE /identity/v3/users/1e30fbf06078414e8a40e1ff4b9a5f7e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:05.487497 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca30ffbc2b84785a0b56d0596ed81d7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.511591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca30ffbc2b84785a0b56d0596ed81d7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.513435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca30ffbc2b84785a0b56d0596ed81d7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:05.524802 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1059/2130] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:05 2022] DELETE /identity/v3/users/4ca30ffbc2b84785a0b56d0596ed81d7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:05.531061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:05.531963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:05.532389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:05.579903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:05.581607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:05.759984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:05.762305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1072/2131] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:05.763663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:05.891796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0a51-181f-4194-8f3f-1c91c7f3c49c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:05.902235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:05.904480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:05.905329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:05.905883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:05.932213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:05.935153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a17ab-a6b6-409f-8841-e5608592584d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:05.975276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1060/2132] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:06.557964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:06.560740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:06.613067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae11f3-8688-4a77-b5b7-ee7ebdff5bbb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:06.636424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:06.640932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:06.641436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:06.641935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] PATH_INFO: `/v3/projects/3bbb856e9b384bee8ac22947ebd08d11` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:06.644673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbb856e9b384bee8ac22947ebd08d11)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:06.649197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:06.791246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbb856e9b384bee8ac22947ebd08d11', 'request_id': 'req-8092403d-07af-49a1-a352-24c9be0e448d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:06.809587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbb856e9b384bee8ac22947ebd08d11', 'request_id': 'req-8092403d-07af-49a1-a352-24c9be0e448d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:06.830292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbb856e9b384bee8ac22947ebd08d11', 'request_id': 'req-8092403d-07af-49a1-a352-24c9be0e448d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:06.903137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] The token cache is being invalidate because project 3bbb856e9b384bee8ac22947ebd08d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:06.903867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:06.905664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8092403d-07af-49a1-a352-24c9be0e448d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:06.916041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1073/2133] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:06 2022] DELETE /identity/v3/projects/3bbb856e9b384bee8ac22947ebd08d11 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:06.917805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:06.918676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:06.918941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:06.951898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:06.955344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:07.052079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1061/2134] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:07.060868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.061282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.061775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.070401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.071937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:07.083529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:07.097584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:07.100304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:07.113370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68ebe-467d-42e5-8a04-bc7f33e59527 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.122522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1074/2135] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:07.124742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.133223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.134597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.135042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.139067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] PATH_INFO: `/v3/projects/ba640ea9f70d4293a2e2fcfec2f74869` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.142215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba640ea9f70d4293a2e2fcfec2f74869)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.146653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.150081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a0c2-7266-477d-9f4b-82ebc41ad746 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.160390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.163535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.164257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.164874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.168057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:07.169295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.171237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.197062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1075/2136] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:07.204901 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.240908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c109c-9ab8-493f-911d-4420e99847f6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.249670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.250783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.251270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.251754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.253353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.256351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.291014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba640ea9f70d4293a2e2fcfec2f74869', 'request_id': 'req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.304366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba640ea9f70d4293a2e2fcfec2f74869', 'request_id': 'req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.311566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1076/2137] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:07.317475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.321966 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba640ea9f70d4293a2e2fcfec2f74869', 'request_id': 'req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] The token cache is being invalidate because project ba640ea9f70d4293a2e2fcfec2f74869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:07.351352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.352745 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.359598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1062/2138] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:07 2022] DELETE /identity/v3/projects/ba640ea9f70d4293a2e2fcfec2f74869 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:07.361719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.364354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:07.401125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:07.451212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198298c-aad7-444b-ad8d-e09f209e43f8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.463589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.464817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.465501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.465990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.468344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.473065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.529003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1077/2139] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:07 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:07.530781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.533058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:07.561491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e9c5e-be1d-41cd-ad97-1fbc83c134e6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.571341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.572990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.573823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.574318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] PATH_INFO: `/v3/users/bba104d1d5804e7fa85b980abc0eaa40` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.577012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba104d1d5804e7fa85b980abc0eaa40)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.577225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1973-6805-42c8-bfcd-304d562cef9e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.587628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.587628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.587628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.588134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.588545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.589584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.591800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.609667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1078/2140] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:07.611325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.627977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d9df-1c16-4432-a1a9-1dfc14fa2680 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.638727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.639874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.640423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.641084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.642086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.652678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.683235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1079/2141] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:07.685523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:07.703885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3550ebc-47e8-492b-b2e1-68d6c005a41e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:07.720969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:07.723337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.724787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.726109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] PATH_INFO: `/v3/projects/5ab5edd321de48fcae19725464c77d55/users/8ec6db5bfc4742cbb4a6ad4632159707/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.761866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba104d1d5804e7fa85b980abc0eaa40'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.791321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab5edd321de48fcae19725464c77d55, user_id=8ec6db5bfc4742cbb4a6ad4632159707, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:07.797051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f4dc-c4fc-4350-9ffe-c28937f4892b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:07.835183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba104d1d5804e7fa85b980abc0eaa40'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.855747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1080/2142] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:07 2022] PUT /identity/v3/projects/5ab5edd321de48fcae19725464c77d55/users/8ec6db5bfc4742cbb4a6ad4632159707/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:07.871685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba104d1d5804e7fa85b980abc0eaa40'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.877473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:07.877932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:07.878433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:07.916428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba104d1d5804e7fa85b980abc0eaa40'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.917241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba104d1d5804e7fa85b980abc0eaa40'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:07.930654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1063/2143] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:07 2022] DELETE /identity/v3/users/bba104d1d5804e7fa85b980abc0eaa40 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:07.933170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] MFA Rules not processed for user `8ec6db5bfc4742cbb4a6ad4632159707`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:07.937441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:08.068132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1081/2144] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:08.082520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:08.085090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:08.094890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:08.241440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0150-cc05-4217-9dbd-2a6be5065a84 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:08.251520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:08.252236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:08.252525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:08.252965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:08.267780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:08.274652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94235bc1-1eda-47a3-8943-a961dba493c8 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:08.302747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1064/2145] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:08.591397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:08.595831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:08.753998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0659024-dc8d-4c7b-972c-f78fdd470774 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:08.764242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:08.765923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:08.766428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:08.766979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] PATH_INFO: `/v3/projects/83399f3a4b51436390fe82bcb9a7b7de` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:08.771671 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83399f3a4b51436390fe82bcb9a7b7de)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:08.778180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:08.817072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:08.930034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83399f3a4b51436390fe82bcb9a7b7de', 'request_id': 'req-f7d428a3-eb04-49bf-befe-a889dbab4791'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:08.940090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83399f3a4b51436390fe82bcb9a7b7de', 'request_id': 'req-f7d428a3-eb04-49bf-befe-a889dbab4791'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:08.964464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83399f3a4b51436390fe82bcb9a7b7de', 'request_id': 'req-f7d428a3-eb04-49bf-befe-a889dbab4791'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:09.008162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] The token cache is being invalidate because project 83399f3a4b51436390fe82bcb9a7b7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:09.011652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:09.012745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7d428a3-eb04-49bf-befe-a889dbab4791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:09.025530 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.026175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.026786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.032066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1082/2146] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:08 2022] DELETE /identity/v3/projects/83399f3a4b51436390fe82bcb9a7b7de => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:09.081274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:09.082628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:09.304204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1065/2147] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:09.306685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.307195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.307654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.356827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:09.359394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:09.389559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.391282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1083/2148] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:09.410869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d012ec3-743c-4b0d-bc5e-50c48b13023b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.433103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.434181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.434469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.434941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.435936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:09.436278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.444031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:09.494128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1066/2149] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:09.496113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.519957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a4048-5ff6-4972-b338-2e51690dd219 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.541900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.542808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.544174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.546968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.548383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.560906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:09.632339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1084/2150] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:09 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:09.635184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.650423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f754c-9586-4530-afa6-9bf77c3359b7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.754110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.755177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.755721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.756307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.757671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.761037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:09.802321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1067/2151] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:09 2022] POST /identity/v3/users => generated 304 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:09.803653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.818884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad2b3-42cf-413b-95b9-175412b39155 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.828397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.829526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.829810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.830090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.831009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.832746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:09.854881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1085/2152] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:09.858740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.890052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9bd-c747-4f7d-bf1f-aa7e87a5ddee admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.902779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.903956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.904481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.904944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.906278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.908756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168273a-dbef-4239-b7c9-ed44c73ee649 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:09.924959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1068/2153] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:09.926673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:09.938903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a331003-ad6c-4db3-991a-c48d8e67b62d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:09.944496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:09.945358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:09.945664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:09.945957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] PATH_INFO: `/v3/projects/5440a45d476347d7875885f215256c17/users/502bb1cadedf43cc9c2f010762f85691/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:09.965456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5440a45d476347d7875885f215256c17, user_id=502bb1cadedf43cc9c2f010762f85691, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:09.968461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:10.002588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1086/2154] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:09 2022] PUT /identity/v3/projects/5440a45d476347d7875885f215256c17/users/502bb1cadedf43cc9c2f010762f85691/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:10.009598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:10.010355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:10.010707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:10.058388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:10.060851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] MFA Rules not processed for user `502bb1cadedf43cc9c2f010762f85691`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:10.063299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:10.187806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1069/2155] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:10.188665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:10.451510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5748f6-3109-4eec-9136-236ecb7575ee admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:10.469063 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:10.470006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:10.470480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:10.472024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:10.475164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:10.481410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:10.577679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1087/2156] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:10 2022] POST /identity/v3/projects => generated 407 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:10.584370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:10.630198 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90829-7aa8-4644-93c1-34a8b56aee5a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:10.794004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:10.796336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:10.797301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:10.797782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:10.799152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:10.827945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:10.907135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1070/2157] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:10 2022] POST /identity/v3/users => generated 310 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:10.914936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:10.953627 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f4ec-cb8d-421d-80e2-b5961414a3fc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:10.966620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:10.968714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:10.970385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:10.971128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:10.972829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:10.978196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:11.030508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1088/2158] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:11.033721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:11.071049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae5f9-f6dc-48f3-ad9f-45c6144474f2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:11.080507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:11.082643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:11.083189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:11.083662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] PATH_INFO: `/v3/projects/718d9e73cbb641aea6ef981287c2356f/users/d13b94cc42d94725a9b82345286dddd5/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:11.123541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=718d9e73cbb641aea6ef981287c2356f, user_id=d13b94cc42d94725a9b82345286dddd5, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:11.132800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:11.175868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1071/2159] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:11 2022] PUT /identity/v3/projects/718d9e73cbb641aea6ef981287c2356f/users/d13b94cc42d94725a9b82345286dddd5/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:11.182568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:11.203283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb872-dd88-4edc-b402-99b3504d0485 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:11.219626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:11.330743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:11.331550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:11.331831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:11.332185 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:11.333208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:11.334860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4751fd-17c1-4661-8204-270c104ccc9e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:11.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1089/2160] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:11.358308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:11.374341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc688-348f-40b0-8935-da7123f6e79a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:11.382987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:11.385565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:11.386016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:11.386800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] PATH_INFO: `/v3/projects/718d9e73cbb641aea6ef981287c2356f/users/d13b94cc42d94725a9b82345286dddd5/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:11.394809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718d9e73cbb641aea6ef981287c2356f, user_id=d13b94cc42d94725a9b82345286dddd5, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:11.401197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:11.438287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1072/2161] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:11 2022] PUT /identity/v3/projects/718d9e73cbb641aea6ef981287c2356f/users/d13b94cc42d94725a9b82345286dddd5/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:11.450133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:11.450532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:11.451017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:11.518444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] MFA Rules not processed for user `d13b94cc42d94725a9b82345286dddd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:11.519242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:11.649528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1090/2162] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:11.664363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:11.666451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:11.757605 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acb857-2ae7-4232-9403-99cd5e665e89 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:11.761696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:11.762698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:11.763175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:11.763529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:11.775185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:11.778830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:11.787811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:11.798154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1073/2163] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:12.002097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:12.013440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabd8e-0b23-42be-a674-57176ba02617 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:12.017667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:12.018353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:12.018639 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:12.018938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:12.110590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:12.111372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0cefc-1988-447f-8cb3-dde030f88118 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:12.122624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1091/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:18.757971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:18.759634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:18.858177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873025b9-670c-4e3b-86de-94fc37d2a23e service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:18.865569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:18.867203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:18.867713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:18.868251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] PATH_INFO: `/v3/users/8ec6db5bfc4742cbb4a6ad4632159707` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:18.871349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec6db5bfc4742cbb4a6ad4632159707)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:18.876434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:18.969734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec6db5bfc4742cbb4a6ad4632159707'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.020589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec6db5bfc4742cbb4a6ad4632159707'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.034934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec6db5bfc4742cbb4a6ad4632159707'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.066266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec6db5bfc4742cbb4a6ad4632159707'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.067381 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec6db5bfc4742cbb4a6ad4632159707'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.083356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1074/2165] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:18 2022] DELETE /identity/v3/users/8ec6db5bfc4742cbb4a6ad4632159707 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:19.091729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:19.092291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:19.092609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:19.123635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:19.123635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:19.156728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:19.229255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1092/2166] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:19.248371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:19.253723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:19.378658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf14c-3c65-428e-9954-7ece5a13ffd1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:19.385208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:19.386350 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:19.386888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:19.387560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:19.406881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:19.410280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e8085-30de-48a6-86e4-9ba1c61a64a2 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:19.430394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1075/2167] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:19.824925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:19.832025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:19.852896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d899b1-20ab-4e11-80fc-aa775f17e46a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:19.861882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:19.863480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:19.863984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:19.864503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] PATH_INFO: `/v3/projects/5ab5edd321de48fcae19725464c77d55` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:19.866944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab5edd321de48fcae19725464c77d55)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:19.872232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:19.966015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab5edd321de48fcae19725464c77d55', 'request_id': 'req-2e3c075f-a451-4853-9a0b-9afdbc016b82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.974765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab5edd321de48fcae19725464c77d55', 'request_id': 'req-2e3c075f-a451-4853-9a0b-9afdbc016b82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:19.984036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab5edd321de48fcae19725464c77d55', 'request_id': 'req-2e3c075f-a451-4853-9a0b-9afdbc016b82'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:20.007336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] The token cache is being invalidate because project 5ab5edd321de48fcae19725464c77d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:20.007809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:20.009145 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e3c075f-a451-4853-9a0b-9afdbc016b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:20.012519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1093/2168] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:19 2022] DELETE /identity/v3/projects/5ab5edd321de48fcae19725464c77d55 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:20.021314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.022190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.022190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.055797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:20.058178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:20.088976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:20.177796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1076/2169] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:20.188154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.188786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.189122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.213004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:20.214761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:20.227855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1094/2170] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:20.233518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.244584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdcb7e-2b74-430f-a3b0-4e904b7f96b7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.250033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.250817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.251151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.251477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.252418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:20.252781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.254738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.269573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1077/2171] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:20.277078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.287269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9e22-9920-4230-b2e9-2c0ea83c4b22 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.292332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.293131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.293410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.293683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.294567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.296670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.339189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1095/2172] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:20 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:20.346558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.360873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd703bb-3b95-45c2-a781-17b3c1e5a87e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.450455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.451316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.452584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.452584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.452905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.454979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.485334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1078/2173] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:20 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:20.489735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.501872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95b928-e137-4540-b3d4-5158b73f5840 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.508394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.509588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.510089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.510591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.512295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.515742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.531473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1096/2174] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:20.537156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.548819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313196-33d9-4596-b15a-291b008e1dd8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.554448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.555153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.555421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.555695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.556488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.558172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920147a-0bf0-4105-b51e-ef3c226988fd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.570640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1079/2175] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:20.575086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.586267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312139c-2fc2-4dc1-b597-48ab985282be admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.591732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.592747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.592953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.593221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] PATH_INFO: `/v3/projects/370f0df7dc4745edb578a5f922c0f57f/users/67481128d30049d29d5f0e66b1a4c970/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.612509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=370f0df7dc4745edb578a5f922c0f57f, user_id=67481128d30049d29d5f0e66b1a4c970, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.615343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.635775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1097/2176] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:20 2022] PUT /identity/v3/projects/370f0df7dc4745edb578a5f922c0f57f/users/67481128d30049d29d5f0e66b1a4c970/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:20.641580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.641862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.642143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.662524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:20.664217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:20.740168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1080/2177] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:20.750787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:20.752781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:20.828909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a2650-7679-4176-a6a0-e9b75faf45ae admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:20.833681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:20.834402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:20.834692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:20.834972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:20.848160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:20.853248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:20.857448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76afaac-e0ee-432e-8c2f-934bd075b653 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:20.877391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1098/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:24.075243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:24.077723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:24.096702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73240b66-c056-4cd6-8bfc-bc7d1db5a3d0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:24.104991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:24.106703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:24.107250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:24.108138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] PATH_INFO: `/v3/users/95cd4911111549d299547c4fb5311639` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:24.111449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cd4911111549d299547c4fb5311639)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:24.116095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:24.173813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:24.270332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cd4911111549d299547c4fb5311639'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:24.303052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cd4911111549d299547c4fb5311639'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:24.332149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cd4911111549d299547c4fb5311639'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:24.360839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cd4911111549d299547c4fb5311639'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:24.361681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cd4911111549d299547c4fb5311639'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:24.422881 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1081/2179] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:24 2022] DELETE /identity/v3/users/95cd4911111549d299547c4fb5311639 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:24.428608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:24.429694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:24.430135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:24.487059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:24.489427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:24.744300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1099/2180] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:24.757758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:24.759538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:24.877028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fb5e6-a41c-4681-b013-197af8803a21 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:24.911963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:24.914082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:24.914082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:24.914082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:24.945946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:24.948816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:24.970797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1082/2181] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:25.775673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:25.777190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:25.805299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989558c-6a58-4a9f-b7e3-6c08703d5a2c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:25.820922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:25.821972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:25.822259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:25.822541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] PATH_INFO: `/v3/projects/2bf9b21cebe04c038bcbe1ebeadbf9cf` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:25.825255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf9b21cebe04c038bcbe1ebeadbf9cf)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:25.827394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:25.978154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf9b21cebe04c038bcbe1ebeadbf9cf', 'request_id': 'req-fc4f99db-572f-47e2-a3fc-d405687b3a57'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.003065 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf9b21cebe04c038bcbe1ebeadbf9cf', 'request_id': 'req-fc4f99db-572f-47e2-a3fc-d405687b3a57'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.056383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf9b21cebe04c038bcbe1ebeadbf9cf', 'request_id': 'req-fc4f99db-572f-47e2-a3fc-d405687b3a57'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.099342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] The token cache is being invalidate because project 2bf9b21cebe04c038bcbe1ebeadbf9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:26.099821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.100555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.104399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1100/2182] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:25 2022] DELETE /identity/v3/projects/2bf9b21cebe04c038bcbe1ebeadbf9cf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:26.111257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:26.129677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be46e-bf1c-4ebc-9f70-c7602a2bac91 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:26.165477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:26.166991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:26.234789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:26.235702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:26.235984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:26.236296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] PATH_INFO: `/v3/users/defd61c79d5943639daacd9283f287b4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:26.238692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defd61c79d5943639daacd9283f287b4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:26.240710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:26.327394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99db-572f-47e2-a3fc-d405687b3a57 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:26.340888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:26.343778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:26.343778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:26.343778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] PATH_INFO: `/v3/users/502bb1cadedf43cc9c2f010762f85691` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:26.351110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=502bb1cadedf43cc9c2f010762f85691)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:26.352251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:26.355234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:26.367803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defd61c79d5943639daacd9283f287b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.415481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defd61c79d5943639daacd9283f287b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.442819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defd61c79d5943639daacd9283f287b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.457371 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:26.466638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defd61c79d5943639daacd9283f287b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.474173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5ea85950-c7d7-42b8-bd63-035e255eee50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defd61c79d5943639daacd9283f287b4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.513811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1083/2183] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:26 2022] DELETE /identity/v3/users/defd61c79d5943639daacd9283f287b4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:26.553227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502bb1cadedf43cc9c2f010762f85691'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.585916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502bb1cadedf43cc9c2f010762f85691'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.639586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502bb1cadedf43cc9c2f010762f85691'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.640948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502bb1cadedf43cc9c2f010762f85691'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.662163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502bb1cadedf43cc9c2f010762f85691'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:26.678930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1101/2184] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:26 2022] DELETE /identity/v3/users/502bb1cadedf43cc9c2f010762f85691 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:26.687235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:26.689456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:26.690409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:26.735808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:26.739002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:26.870759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1084/2185] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:26.885688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:26.907078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:27.164060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1faf-84f6-435b-bcc5-67af99c1c1df admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:27.177058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:27.179635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:27.181462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:27.181951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:27.262795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:27.269993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c725b-76a3-4019-babd-f2b4c47c3e71 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:27.278857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:27.280641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:27.312458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1102/2186] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:27.399555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8609b-3e00-4ded-8ae0-7ee3be6546c3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:27.414775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:27.416364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:27.416545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:27.416867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] PATH_INFO: `/v3/projects/d3b1c49ae6f94c918aab76b892c76db1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:27.418948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b1c49ae6f94c918aab76b892c76db1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:27.421007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:27.530720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b1c49ae6f94c918aab76b892c76db1', 'request_id': 'req-6dc8206c-3510-4b2e-a94d-f822b1b08793'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:27.553583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b1c49ae6f94c918aab76b892c76db1', 'request_id': 'req-6dc8206c-3510-4b2e-a94d-f822b1b08793'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:27.576924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b1c49ae6f94c918aab76b892c76db1', 'request_id': 'req-6dc8206c-3510-4b2e-a94d-f822b1b08793'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:27.606678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] The token cache is being invalidate because project d3b1c49ae6f94c918aab76b892c76db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:27.607329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:27.610069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6dc8206c-3510-4b2e-a94d-f822b1b08793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:27.614394 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1085/2187] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:27 2022] DELETE /identity/v3/projects/d3b1c49ae6f94c918aab76b892c76db1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:27.621765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:27.622261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:27.622720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:27.711396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:27.713633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:27.905069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:28.003753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1103/2188] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:28.021478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.022400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.022400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.070761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.072249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:28.100490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561e5aa-c6fe-4361-97d7-51025333345d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.103901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:28.105063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:28.130490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.132584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.132903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.133183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] PATH_INFO: `/v3/projects/5440a45d476347d7875885f215256c17` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.138562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5440a45d476347d7875885f215256c17)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.146037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1086/2189] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:28.147681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.154379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.160972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:28.173983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58799c7-1aa5-4f4c-9053-9598d14c7d04 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.191889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.193824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.194029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.195459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.197824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:28.198179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.204458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.241049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1087/2190] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:06:28.245049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.271103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19cc55-afd0-46b2-8048-ad75d372bc89 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.289607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5440a45d476347d7875885f215256c17', 'request_id': 'req-044f7dbc-18a7-4f79-bc26-0709082cf503'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.301558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5440a45d476347d7875885f215256c17', 'request_id': 'req-044f7dbc-18a7-4f79-bc26-0709082cf503'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.312926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5440a45d476347d7875885f215256c17', 'request_id': 'req-044f7dbc-18a7-4f79-bc26-0709082cf503'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.356875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] The token cache is being invalidate because project 5440a45d476347d7875885f215256c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:28.357242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.370970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.379781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1104/2191] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:28 2022] DELETE /identity/v3/projects/5440a45d476347d7875885f215256c17 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:28.390500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.396188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:28.478447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.482738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.484046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.484231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.485275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.491227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.588176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1088/2192] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:28 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:28.589884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.594150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:28.621832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f7dbc-18a7-4f79-bc26-0709082cf503 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.721130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04fae-9098-44c9-9517-9b204706268d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.729179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.730987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.731466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.735927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.737268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.739658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.757313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.759211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.759963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.759963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] PATH_INFO: `/v3/users/d13b94cc42d94725a9b82345286dddd5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.762257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13b94cc42d94725a9b82345286dddd5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.764579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.770510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:28.778757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1089/2193] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:28 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:28.781561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.812777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991fdc-bc79-4d19-aa2b-eaac811697fc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.846988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.848908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.850773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.851689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.854099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.868724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.900328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1090/2194] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:28.901825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:28.918251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13b94cc42d94725a9b82345286dddd5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.919875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1022-d9fa-429a-980e-976cdcc85215 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:28.925391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:28.927213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:28.927596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:28.928391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:28.929029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:28.930919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:28.940918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13b94cc42d94725a9b82345286dddd5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.980950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13b94cc42d94725a9b82345286dddd5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:28.984020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13b94cc42d94725a9b82345286dddd5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:29.006190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1091/2195] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:29.007813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:29.013121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-28e6fc8a-ffa2-4112-af3b-c63862ddddfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13b94cc42d94725a9b82345286dddd5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:29.014404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:29.029720 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1105/2196] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:28 2022] DELETE /identity/v3/users/d13b94cc42d94725a9b82345286dddd5 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:29.072081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd52e-3403-4c8f-8bde-3dd61c8cef08 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:29.175223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:29.200781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:29.201719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:29.201994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:29.202274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] PATH_INFO: `/v3/projects/f7fc6c30b41f4676823e869c34c81af2/users/76d99f8103524854802db8a8207b1956/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:29.239374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fc6c30b41f4676823e869c34c81af2, user_id=76d99f8103524854802db8a8207b1956, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:29.244476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ce03c-8859-400e-a2d1-173718944dd7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:29.275043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1092/2197] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:29 2022] PUT /identity/v3/projects/f7fc6c30b41f4676823e869c34c81af2/users/76d99f8103524854802db8a8207b1956/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:29.297607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:29.298122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:29.298584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:29.422055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] MFA Rules not processed for user `76d99f8103524854802db8a8207b1956`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:29.427651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:29.528794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:29.529366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:29.530388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:29.602843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] MFA Rules not processed for user `67481128d30049d29d5f0e66b1a4c970`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:29.604537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:29.640360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1106/2198] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:29.641502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:29.806716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799e766-c5e1-4784-8e5b-b7350fd10646 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:29.815139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1093/2199] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:29.821617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:29.824517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:29.824945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:29.825122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:29.825262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:29.826913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:29.830543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:29.832511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:29.858545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7109bb-32c8-4ae7-a2e3-8a6deabc796a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:29.881439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:29.882626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:29.883250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:29.883756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:29.884810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:29.888169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:29.898860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:29.941809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1107/2200] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:29.943748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:29.944420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1094/2201] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:29.949534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.160073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653cba1-3e9d-4918-8a3a-992bb34eda20 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.212448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e167b-27ee-42f4-a5e7-58cb6c9247ab admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.222029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.223307 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.223800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.224314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.225617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.236349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.297325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.298630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.298981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.299321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.300176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.302452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.357525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1095/2202] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/users => generated 296 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:30.363444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.381424 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1108/2203] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:29 2022] POST /identity/v3/users => generated 294 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:30.389481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.391867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60a54a-21d8-4d80-ae0e-627b33bc6ff3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.400972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.402942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.403512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.403956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.406570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.410824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.415557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda63f0-fb34-4bb8-a536-0a1860d886e5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.432915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.433876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.434262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.434931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.435565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.437533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1096/2204] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:30.437727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.446220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.464693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1109/2205] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:30.470324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.475502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b753c-40a3-4bf0-931f-891d479b524e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.486379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a302f-f7c5-4c81-9f0f-ef25724556cd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.492075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.494243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.494816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.495423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] PATH_INFO: `/v3/projects/5876c554325d4b499be50df57589c242/users/f0ef0465c5fc4ac98aa2240223cc00ce/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.503305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.507024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.507270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.507956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.511101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.521338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.537713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:30.548882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1110/2206] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:30.549973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.552953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:30.559138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5876c554325d4b499be50df57589c242, user_id=f0ef0465c5fc4ac98aa2240223cc00ce, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.565720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.571155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781e04-a817-45da-bc5a-1d601711d401 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.581435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.583516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.583863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.584184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] PATH_INFO: `/v3/projects/718d9e73cbb641aea6ef981287c2356f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.585680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] RBAC: Authorizing `identity:delete_project(project_id=718d9e73cbb641aea6ef981287c2356f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.587866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.592088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1097/2207] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:30 2022] PUT /identity/v3/projects/5876c554325d4b499be50df57589c242/users/f0ef0465c5fc4ac98aa2240223cc00ce/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:30.592088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.657313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718d9e73cbb641aea6ef981287c2356f', 'request_id': 'req-a7673848-0704-46b7-833f-fd1ef1c4964b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:30.665807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718d9e73cbb641aea6ef981287c2356f', 'request_id': 'req-a7673848-0704-46b7-833f-fd1ef1c4964b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:30.674268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718d9e73cbb641aea6ef981287c2356f', 'request_id': 'req-a7673848-0704-46b7-833f-fd1ef1c4964b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:30.678842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:30.693575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] The token cache is being invalidate because project 718d9e73cbb641aea6ef981287c2356f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:30.693990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:30.696661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:30.702341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1111/2208] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:30 2022] DELETE /identity/v3/projects/718d9e73cbb641aea6ef981287c2356f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:30.702341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.702341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:30.714502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b183f-c69e-4ca2-bbd7-c641eda83718 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.789594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673848-0704-46b7-833f-fd1ef1c4964b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.797256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.798115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.798405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.798672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.799432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.801272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042bfcb-4e72-4824-8e29-48c440e64fdf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.824451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1112/2209] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:30.828262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.828765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.829626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.859821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:30.861665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:30.869144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.870737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.871220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.871797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] PATH_INFO: `/v3/projects/6d0ced3c49474208b050ea4331bdf3f6/users/a33d1ba42aeb476498d23f2315bb2acc/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.878574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1113/2210] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:30.879552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:30.890925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ad2d9-3bd6-4a42-950c-a2708ce472eb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:30.895894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:30.897037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.897318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.897588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] PATH_INFO: `/v3/projects/5876c554325d4b499be50df57589c242/users/f0ef0465c5fc4ac98aa2240223cc00ce/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.899924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5876c554325d4b499be50df57589c242, user_id=f0ef0465c5fc4ac98aa2240223cc00ce, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.900584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0ced3c49474208b050ea4331bdf3f6, user_id=a33d1ba42aeb476498d23f2315bb2acc, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:30.903536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78b518-c292-43ab-a9d6-8c87ef4227c5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.906447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641083f8-b817-4b9c-8872-e5c3007d463f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:30.918705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1114/2211] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:30 2022] PUT /identity/v3/projects/5876c554325d4b499be50df57589c242/users/f0ef0465c5fc4ac98aa2240223cc00ce/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:30.920977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.921477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.921958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:30.952561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1098/2212] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:30 2022] PUT /identity/v3/projects/6d0ced3c49474208b050ea4331bdf3f6/users/a33d1ba42aeb476498d23f2315bb2acc/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:30.962927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:30.969222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:30.984310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:30.985445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:30.986540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.042253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] MFA Rules not processed for user `a33d1ba42aeb476498d23f2315bb2acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:31.044032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:31.098367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1115/2213] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:31.104389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.121885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275521d0-d098-4574-a878-02d06032e2d2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.128567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.129645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.129902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.130300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.131369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:31.131748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.134074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.151120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1099/2214] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:31.153687 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1116/2215] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:31.157826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.159554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.160359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:31.180390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e83e0-b37a-4895-ab31-d17ef6fb164e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.183074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434c5ee-ce07-464a-a1e3-7f25b7e649e3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.189303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.190370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.190902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.191102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.192134 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.194331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.197658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.198566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.199055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.200884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.202820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.206775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.219294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:31.260723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1117/2216] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:31 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:31.267898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.304303 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1100/2217] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:31 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:31.307735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.402690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:31.427696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16080120-48bd-4cd8-8057-374428b05180 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.442626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.445711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.446736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.447479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.450767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.457724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.497586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbb36-c8c2-4f29-82b9-f090f0cb67a2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.507722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.508745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.509232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.509693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.510998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.520690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1101/2218] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:31 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:31.525375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.538614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.540991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe61ea-c774-4c4e-953e-d4d78697508c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.557389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.558408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.558902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.559356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.560904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.566088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.615144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1118/2219] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:31 2022] POST /identity/v3/users => generated 284 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:31.622349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1102/2220] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:31.632552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.635169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.662209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef96e-c02c-4b24-bc4b-faec1a16243e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.673479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56c1fd-0d43-4b76-a821-b91651c28335 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.676736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.678314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.678609 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.680197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] PATH_INFO: `/v3/projects/7f0cac548d27462e8714ce57042bff2c/users/2b6af985cd6040f19e0817ab3cfb72ec/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.681811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.682637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.683014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.683565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.684905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.687128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.730391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0cac548d27462e8714ce57042bff2c, user_id=2b6af985cd6040f19e0817ab3cfb72ec, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.734543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.738682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1119/2221] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:31.739954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.767055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1103/2222] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:31 2022] PUT /identity/v3/projects/7f0cac548d27462e8714ce57042bff2c/users/2b6af985cd6040f19e0817ab3cfb72ec/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:31.770451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2499-b576-4df4-a775-f653385b1345 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.772911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.915539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.917179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.918094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.920702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.922964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.925769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.948996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1120/2223] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:31.950246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:31.951845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c45f-605f-4e00-99b8-4e6d495beb5e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.964533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.965294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.967250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3674-c6b0-49ed-bb9d-a5cbea5b3786 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:31.967818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.967818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:31.969312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:31.974220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:31.975496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:31.976155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:31.976280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:31.976871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] PATH_INFO: `/v3/projects/acb194f1996148f0973ace253e60b5b5/users/5010b20f26c5483fb0c1bb7678441b73/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.007762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1104/2224] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:32.013755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:32.045226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998ab6-e7b7-4a5b-bc14-1e8ceb936888 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:32.050161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb194f1996148f0973ace253e60b5b5, user_id=5010b20f26c5483fb0c1bb7678441b73, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:32.056544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93b7bb-0113-4821-a867-36b66e081336 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:32.067786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:32.070088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.070335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.070608 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] PATH_INFO: `/v3/projects/7f0cac548d27462e8714ce57042bff2c/users/2b6af985cd6040f19e0817ab3cfb72ec/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.085410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0cac548d27462e8714ce57042bff2c, user_id=2b6af985cd6040f19e0817ab3cfb72ec, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:32.094144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c30b-7d2b-420c-bf2b-50b0f6a0e2df admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:32.112372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1121/2225] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:31 2022] PUT /identity/v3/projects/acb194f1996148f0973ace253e60b5b5/users/5010b20f26c5483fb0c1bb7678441b73/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:32.123225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186428-422d-4966-90a3-adfb93144e48 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.123497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186428-422d-4966-90a3-adfb93144e48 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.123782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186428-422d-4966-90a3-adfb93144e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.132047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1105/2226] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:32 2022] PUT /identity/v3/projects/7f0cac548d27462e8714ce57042bff2c/users/2b6af985cd6040f19e0817ab3cfb72ec/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:32.151362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.152806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.153274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.178950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-97186428-422d-4966-90a3-adfb93144e48 None None] MFA Rules not processed for user `5010b20f26c5483fb0c1bb7678441b73`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:32.180167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-97186428-422d-4966-90a3-adfb93144e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:32.222091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] MFA Rules not processed for user `2b6af985cd6040f19e0817ab3cfb72ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:32.223938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:32.259173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:32.339041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1122/2227] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:32.343945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186428-422d-4966-90a3-adfb93144e48 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:32.359332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:32.438154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1106/2228] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:32.476546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:32.480161 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:32.574282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186428-422d-4966-90a3-adfb93144e48 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:32.595319 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:32.596589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.596589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.596902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.599920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:32.602122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:32.664059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b690-d983-4553-b536-4bfd93d18912 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:32.676340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1123/2229] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:32 2022] POST /identity/v3/projects => generated 365 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:32.680492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:32.681184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.681475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.681747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.683246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:32.714533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:32.720821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488f861-bab0-4059-b75e-33a3c632e402 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:32.769596 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1107/2230] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:32.890797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5f366-c681-4e59-9b8b-b1f7cd424f50 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:32.906488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:32.908310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.909209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.909995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:32.911625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:32.917850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:32.960306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:32.965483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:32.967221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.014685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1124/2231] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:32 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:33.029374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:33.032268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] MFA Rules not processed for user `101810e54c274bf48c3cab586d24e764`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:33.034906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:33.086983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba71e-8e24-4c08-be4e-54e0c8650ac1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:33.121581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:33.123842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:33.124574 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:33.125211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.129033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:33.137037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:33.191841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1125/2232] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:33.196811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1108/2233] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:33.198347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:33.229829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8098fd7-48ac-4f20-b650-d755fd0a77d9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:33.246814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:33.247929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:33.248240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:33.248980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] PATH_INFO: `/v3/projects/3449515fd8ae4116bb56810ef3f01eda/users/73809f28bace4b07a488339bd9326386/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.298547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3449515fd8ae4116bb56810ef3f01eda, user_id=73809f28bace4b07a488339bd9326386, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:33.310367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:33.345926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1126/2234] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:33 2022] PUT /identity/v3/projects/3449515fd8ae4116bb56810ef3f01eda/users/73809f28bace4b07a488339bd9326386/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:33.360432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:33.391977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80192d1-8fa2-407a-9f08-e86648c622b3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:33.636330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:33.653003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:33.653742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:33.654023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:33.654296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.655050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:33.656789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094046c-d7b5-4c1b-89e9-44b3a31413d9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:33.678531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1109/2235] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:33.685690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:33.709451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f428-7469-4a82-8644-fd5824cbdd77 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:33.725447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:33.729248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:33.730604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:33.731531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] PATH_INFO: `/v3/projects/3449515fd8ae4116bb56810ef3f01eda/users/73809f28bace4b07a488339bd9326386/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.739935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3449515fd8ae4116bb56810ef3f01eda, user_id=73809f28bace4b07a488339bd9326386, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:33.768637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:33.814003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1127/2236] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:33 2022] PUT /identity/v3/projects/3449515fd8ae4116bb56810ef3f01eda/users/73809f28bace4b07a488339bd9326386/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:33.833757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:33.834044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:33.834606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:33.930404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] MFA Rules not processed for user `73809f28bace4b07a488339bd9326386`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:33.933985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:34.111202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:34.117238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:34.147269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1110/2237] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:34.199725 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:34.241252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:34.326550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01d28-21ad-4041-8425-dc4cf11e6808 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:34.333280 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:34.334400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:34.334944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:34.335270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:34.338238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:34.407603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09761f-366b-4e68-a093-4bb6886998dc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:34.413696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:34.414531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:34.416617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:34.417728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:34.442867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:34.445818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:34.504481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1111/2238] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:34.524295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:34.528833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:34.547467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1128/2239] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:34.731472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:34.770461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dbd67-3c82-4f0c-8ef1-6c3cf4dc94e7 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:34.789087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:34.793510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:34.794330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:34.794957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:35.005785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:35.007939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf496-0981-485c-a02f-6156a9b21445 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:35.040079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1112/2240] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:38.276932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:38.280923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:38.544916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed545d-7d90-4e39-b216-b1f9ae0cba93 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:38.573277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:38.574788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:38.575165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:38.575443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] PATH_INFO: `/v3/users/7bdf45e46b4d4512b5679425acb133fa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:38.584952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdf45e46b4d4512b5679425acb133fa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:38.587050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:38.777454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdf45e46b4d4512b5679425acb133fa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:38.795659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdf45e46b4d4512b5679425acb133fa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:38.858409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:38.864631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdf45e46b4d4512b5679425acb133fa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:38.866419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdf45e46b4d4512b5679425acb133fa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:38.887349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdf45e46b4d4512b5679425acb133fa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:38.911117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1129/2241] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:38 2022] DELETE /identity/v3/users/7bdf45e46b4d4512b5679425acb133fa => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:38.914451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727ad7-750f-4722-a118-276637499eba None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:38.914451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727ad7-750f-4722-a118-276637499eba None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:38.914451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727ad7-750f-4722-a118-276637499eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:38.984995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-32727ad7-750f-4722-a118-276637499eba None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:38.988295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32727ad7-750f-4722-a118-276637499eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:39.020415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:39.240991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1113/2242] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:39.311229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:39.312903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:39.552916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2878-6373-40ef-83cc-676d9618d8b5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:39.583591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:39.584632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:39.585107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:39.585566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:39.633064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:39.634856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:39.650899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1130/2243] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:40.393239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727ad7-750f-4722-a118-276637499eba None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:40.398515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32727ad7-750f-4722-a118-276637499eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:40.592806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727ad7-750f-4722-a118-276637499eba None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:40.614666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:40.616065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:40.616913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:40.620906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:40.625454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:40.744845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:40.748988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f062f1-f448-4924-bd1e-ed3bcc2e592f service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:40.772202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1114/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:41.567091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:41.570837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:41.593479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf382-4a77-42a1-a020-ba0b368c5d7e service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:41.613068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:41.614068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:41.614406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:41.614701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] PATH_INFO: `/v3/projects/448b05bacce2486aa8369a5865abfd75` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:41.617979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448b05bacce2486aa8369a5865abfd75)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:41.621536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:41.794018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448b05bacce2486aa8369a5865abfd75', 'request_id': 'req-d5f02991-9e37-4c46-a859-68d648844be6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:41.817603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448b05bacce2486aa8369a5865abfd75', 'request_id': 'req-d5f02991-9e37-4c46-a859-68d648844be6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:41.836172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448b05bacce2486aa8369a5865abfd75', 'request_id': 'req-d5f02991-9e37-4c46-a859-68d648844be6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:41.867146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] The token cache is being invalidate because project 448b05bacce2486aa8369a5865abfd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:41.867726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:41.868815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:41.875510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1131/2245] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:41 2022] DELETE /identity/v3/projects/448b05bacce2486aa8369a5865abfd75 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:43.951130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:43.951951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:43.951951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:43.986308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] MFA Rules not processed for user `f0ef0465c5fc4ac98aa2240223cc00ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:43.988028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:44.109531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:44.140187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1115/2246] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:44.152420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:44.154038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:44.299762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02991-9e37-4c46-a859-68d648844be6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:44.327613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:44.328443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:44.328730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:44.329329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:44.334003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:44.359274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:44.479259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:44.501821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:44.549920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1132/2247] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:45.045602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:45.052110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.120160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:45.126750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.268036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bafeb-e826-425e-bd1b-c0e0b1955f17 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:45.280772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:45.283672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:45.285947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:45.286776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] PATH_INFO: `/v3/users/76d99f8103524854802db8a8207b1956` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:45.290707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d99f8103524854802db8a8207b1956)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:45.295317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:45.355345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acbfd0-87ee-4dc6-b319-38efe8577a57 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:45.366420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:45.368748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:45.369535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:45.370047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] PATH_INFO: `/v3/users/5010b20f26c5483fb0c1bb7678441b73` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:45.373999 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5010b20f26c5483fb0c1bb7678441b73)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:45.378598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:45.448933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d99f8103524854802db8a8207b1956'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.505114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d99f8103524854802db8a8207b1956'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.521734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5010b20f26c5483fb0c1bb7678441b73'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.527173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d99f8103524854802db8a8207b1956'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.543495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d99f8103524854802db8a8207b1956'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.545317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c17a2295-ccba-4ffb-8339-7e5deefd91bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d99f8103524854802db8a8207b1956'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.552017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5010b20f26c5483fb0c1bb7678441b73'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.556075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1116/2248] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:45 2022] DELETE /identity/v3/users/76d99f8103524854802db8a8207b1956 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:45.565506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476384-8377-4af7-8cc5-83b246133491 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:45.569211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476384-8377-4af7-8cc5-83b246133491 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:45.570002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476384-8377-4af7-8cc5-83b246133491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:45.600799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5010b20f26c5483fb0c1bb7678441b73'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.602823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5010b20f26c5483fb0c1bb7678441b73'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.622150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-30476384-8377-4af7-8cc5-83b246133491 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:45.624819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-30476384-8377-4af7-8cc5-83b246133491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.629169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-24a26376-309c-437d-8720-d0465ec6f6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5010b20f26c5483fb0c1bb7678441b73'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:45.660502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1133/2249] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:45 2022] DELETE /identity/v3/users/5010b20f26c5483fb0c1bb7678441b73 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:45.663692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:45.665082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:45.665655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:45.716956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:45.721408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.768213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1117/2250] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:45.790745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:45.803004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30476384-8377-4af7-8cc5-83b246133491 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:45.804770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-30476384-8377-4af7-8cc5-83b246133491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.837635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:45.893071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1134/2251] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:45.920329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:45.922821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:45.966139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30476384-8377-4af7-8cc5-83b246133491 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:46.067694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:46.068835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:46.068835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:46.069152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:46.095725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:46.097351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:46.128158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1118/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:46.178108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ba792-78f8-4371-a4a9-ce0f70e32724 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:46.195641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:46.197984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:46.198491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:46.198974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:46.241241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:46.246375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:46.271345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1135/2253] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:47.067222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:47.070906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:47.089695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6a1f-4b37-4d0d-977b-dddc5e84ef88 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:47.102781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:47.104399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:47.105409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:47.106125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] PATH_INFO: `/v3/projects/f7fc6c30b41f4676823e869c34c81af2` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:47.107872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fc6c30b41f4676823e869c34c81af2)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:47.110298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:47.219719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fc6c30b41f4676823e869c34c81af2', 'request_id': 'req-961086ae-4cbf-4fed-a7c6-d37375584398'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.253006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fc6c30b41f4676823e869c34c81af2', 'request_id': 'req-961086ae-4cbf-4fed-a7c6-d37375584398'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.296304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fc6c30b41f4676823e869c34c81af2', 'request_id': 'req-961086ae-4cbf-4fed-a7c6-d37375584398'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.314503 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:47.316612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:47.337433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] The token cache is being invalidate because project f7fc6c30b41f4676823e869c34c81af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:47.339545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.340747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52d07-6527-49a4-a128-a8e69707240f service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:47.342687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.361203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1119/2254] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:47 2022] DELETE /identity/v3/projects/f7fc6c30b41f4676823e869c34c81af2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:47.367276 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:47.373634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:47.527246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:47.528313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:47.536403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:47.536900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] PATH_INFO: `/v3/projects/acb194f1996148f0973ace253e60b5b5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:47.544042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb194f1996148f0973ace253e60b5b5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:47.548439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:47.572873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:47.588974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961086ae-4cbf-4fed-a7c6-d37375584398 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:47.601515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:47.603806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:47.604357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:47.605226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] PATH_INFO: `/v3/users/a33d1ba42aeb476498d23f2315bb2acc` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:47.610243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33d1ba42aeb476498d23f2315bb2acc)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:47.615287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:47.702879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb194f1996148f0973ace253e60b5b5', 'request_id': 'req-90391679-8f55-45c7-8239-23cacd109b5b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.718269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb194f1996148f0973ace253e60b5b5', 'request_id': 'req-90391679-8f55-45c7-8239-23cacd109b5b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.741068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb194f1996148f0973ace253e60b5b5', 'request_id': 'req-90391679-8f55-45c7-8239-23cacd109b5b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.757392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33d1ba42aeb476498d23f2315bb2acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.795083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33d1ba42aeb476498d23f2315bb2acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.803211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] The token cache is being invalidate because project acb194f1996148f0973ace253e60b5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:47.808261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.810472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.811071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33d1ba42aeb476498d23f2315bb2acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.822084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1136/2255] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:47 2022] DELETE /identity/v3/projects/acb194f1996148f0973ace253e60b5b5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:47.829244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33d1ba42aeb476498d23f2315bb2acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.830084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:47.832345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33d1ba42aeb476498d23f2315bb2acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:47.842259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:47.853568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1120/2256] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:47 2022] DELETE /identity/v3/users/a33d1ba42aeb476498d23f2315bb2acc => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:47.855794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:48.146513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391679-8f55-45c7-8239-23cacd109b5b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:48.427711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:48.429364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:48.429847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:48.430321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] PATH_INFO: `/v3/users/73809f28bace4b07a488339bd9326386` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:48.440296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73809f28bace4b07a488339bd9326386)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:48.449153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:48.650546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73809f28bace4b07a488339bd9326386'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:48.692490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73809f28bace4b07a488339bd9326386'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:48.776382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73809f28bace4b07a488339bd9326386'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:48.780620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73809f28bace4b07a488339bd9326386'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:48.809356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73809f28bace4b07a488339bd9326386'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:48.836303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1137/2257] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:47 2022] DELETE /identity/v3/users/73809f28bace4b07a488339bd9326386 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:49.103794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:49.106199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:49.129752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e49d1-88ca-49e5-adbb-8fd1c4ef26bf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:49.222876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:49.224258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:49.224811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:49.225363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] PATH_INFO: `/v3/projects/6d0ced3c49474208b050ea4331bdf3f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:49.227487 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0ced3c49474208b050ea4331bdf3f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:49.230257 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:49.306848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0ced3c49474208b050ea4331bdf3f6', 'request_id': 'req-db412544-1ed2-4432-a40b-caee0098a13e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.316998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0ced3c49474208b050ea4331bdf3f6', 'request_id': 'req-db412544-1ed2-4432-a40b-caee0098a13e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.327690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0ced3c49474208b050ea4331bdf3f6', 'request_id': 'req-db412544-1ed2-4432-a40b-caee0098a13e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.351193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] The token cache is being invalidate because project 6d0ced3c49474208b050ea4331bdf3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:49.351577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.352478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.356433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1121/2258] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:49 2022] DELETE /identity/v3/projects/6d0ced3c49474208b050ea4331bdf3f6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:49.362473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:49.366207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:49.436815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114dfc-a3df-4079-8d03-299deaa62ef3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:49.526058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:49.617792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:49.619498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:49.621124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:49.621756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] PATH_INFO: `/v3/users/2b6af985cd6040f19e0817ab3cfb72ec` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:49.625402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6af985cd6040f19e0817ab3cfb72ec)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:49.629041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:49.814488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6af985cd6040f19e0817ab3cfb72ec'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.848916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6af985cd6040f19e0817ab3cfb72ec'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.870995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6af985cd6040f19e0817ab3cfb72ec'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.872278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6af985cd6040f19e0817ab3cfb72ec'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.883884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e21d461-3d8c-4fa8-85f3-05d5dc820da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6af985cd6040f19e0817ab3cfb72ec'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:49.896062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1138/2259] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:49 2022] DELETE /identity/v3/users/2b6af985cd6040f19e0817ab3cfb72ec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:50.168151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:50.170798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:50.227625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:50.258734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412544-1ed2-4432-a40b-caee0098a13e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:50.471676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:50.473215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:50.473622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:50.474016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] PATH_INFO: `/v3/projects/3449515fd8ae4116bb56810ef3f01eda` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:50.476922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3449515fd8ae4116bb56810ef3f01eda)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:50.482570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:50.562454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3449515fd8ae4116bb56810ef3f01eda', 'request_id': 'req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:50.572501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3449515fd8ae4116bb56810ef3f01eda', 'request_id': 'req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:50.598519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3449515fd8ae4116bb56810ef3f01eda', 'request_id': 'req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:50.635009 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] The token cache is being invalidate because project 3449515fd8ae4116bb56810ef3f01eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:50.635632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:50.636659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:50.642150 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1122/2260] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:50 2022] DELETE /identity/v3/projects/3449515fd8ae4116bb56810ef3f01eda => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:50.644232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9bc6-7699-4a57-9db0-032d88e2ecb2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:50.645197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9bc6-7699-4a57-9db0-032d88e2ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:50.645916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9bc6-7699-4a57-9db0-032d88e2ecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:50.699718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:50.701554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:50.849862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef636d-72e8-45e2-9bc6-69c8a2f91cbb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:50.856039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:50.857166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:50.857678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:50.857842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] PATH_INFO: `/v3/projects/7f0cac548d27462e8714ce57042bff2c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:50.859583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0cac548d27462e8714ce57042bff2c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:50.861722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:50.894362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ce0e9bc6-7699-4a57-9db0-032d88e2ecb2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:50.903365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ce0e9bc6-7699-4a57-9db0-032d88e2ecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:50.943219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:50.971542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1139/2261] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:50.973268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:50.973726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:50.973846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:50.982144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0cac548d27462e8714ce57042bff2c', 'request_id': 'req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:51.001011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0cac548d27462e8714ce57042bff2c', 'request_id': 'req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:51.018598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0cac548d27462e8714ce57042bff2c', 'request_id': 'req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:51.030260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:51.033070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:51.064943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] The token cache is being invalidate because project 7f0cac548d27462e8714ce57042bff2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:51.065420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:51.067406 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8d40d26-3502-4c0f-ba6d-ee4b651364b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:51.080581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1123/2262] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:50 2022] DELETE /identity/v3/projects/7f0cac548d27462e8714ce57042bff2c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:51.081299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130129-59fd-48f9-b4e7-bdc40bb1a1a1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.081608 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130129-59fd-48f9-b4e7-bdc40bb1a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.081890 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130129-59fd-48f9-b4e7-bdc40bb1a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.126293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0b130129-59fd-48f9-b4e7-bdc40bb1a1a1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:51.130188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0b130129-59fd-48f9-b4e7-bdc40bb1a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:51.252799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1140/2263] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:51.256679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.268113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1124/2264] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:51.270045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.270283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.270524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.294195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:51.295450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:51.297049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059257-f0b5-48a2-a0f4-437601182a37 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.327844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.329373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.329835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.330507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.332265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:51.332804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.335804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.341437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1125/2265] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:51.344143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.372070 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1141/2266] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:06:51.374930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.379473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e58b-3f5a-48b0-a1e3-e152e6e83a84 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.402826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94ea37-643d-4b32-896a-fc5004a9cce9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.410242 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.416646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.417607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.418328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.422725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:51.424623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.429173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.431221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.440273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.441973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.444431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.448508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.477118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.486050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:51.514466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1126/2267] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:51.519936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.547411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99c5c-cd65-470c-b061-78ce3a3bf7aa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.549520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1142/2268] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:51.554131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.672130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.672887 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.673175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.673452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.674173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.676361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.677071 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9981-d903-4039-9cab-196bf24b51e6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.699660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.700940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.703133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.703657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.705307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.717546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.745778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1127/2269] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:51.751328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.771452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1143/2270] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:51.775715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.792452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3fc51-a90d-4bf2-98dc-4537077f065b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.846612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:51.918480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774255c-3791-4432-ad08-9aad056de59c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.926027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.927326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.927488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.927875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.928424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:51.928561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.928999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:51.929491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:51.929969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.930815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:51.933358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.940779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:51.964236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1144/2271] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:51.966664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.988220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b2b8e-7ebf-4770-a08a-64c50deec31a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:51.988492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1128/2272] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:51 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:51.989794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:51.998235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:51.999454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.000181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.000691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.002263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.004810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d3939-07d6-4d8c-a482-801adea47feb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.005695 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.029060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.029060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.029060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.029060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.030361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.033861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1145/2273] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:52.034039 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.036204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.057287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec955e-c277-4155-863a-6a82df575f72 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.065614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1129/2274] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:52.067826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.069614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.070703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.071000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.071282 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] PATH_INFO: `/v3/projects/5bd3d12aaf9542819a88a5ce5df43d2f/users/daa38b0f350f4fbcaab42839491a2f8d/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.089475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a6e2-240c-4152-a437-33fffc83e252 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.099323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.100560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.101088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.101862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.103109 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.107319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.108252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd3d12aaf9542819a88a5ce5df43d2f, user_id=daa38b0f350f4fbcaab42839491a2f8d, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.110981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c914-2e6d-4620-b4c2-c4e9ad7a3e27 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.146175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1130/2275] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:52.148588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1146/2276] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:52 2022] PUT /identity/v3/projects/5bd3d12aaf9542819a88a5ce5df43d2f/users/daa38b0f350f4fbcaab42839491a2f8d/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:52.155119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.157241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.157929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.158578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.174058 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360f84-4ea3-4ac5-a18c-b8a9f6a8255d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.219103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] MFA Rules not processed for user `daa38b0f350f4fbcaab42839491a2f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:52.221246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:52.272286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:52.336590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.338331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.338900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.339399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] PATH_INFO: `/v3/projects/90e9b14593dd4ef4a1a44e60599c661b/users/b80cf106031e412e9a68467c82ecb498/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.357057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1147/2277] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:52.365679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.384218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e9b14593dd4ef4a1a44e60599c661b, user_id=b80cf106031e412e9a68467c82ecb498, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.390638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4cce5-090d-425f-9a6d-c308206844f8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.390910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fd935-e9d7-4d55-8465-3ec3a547ebe2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.397094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.397920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.398251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.398620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.399351 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.401780 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fe40b-ea7d-4193-b6ec-46c600a933c8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.412692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1131/2278] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:52 2022] PUT /identity/v3/projects/90e9b14593dd4ef4a1a44e60599c661b/users/b80cf106031e412e9a68467c82ecb498/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:52.414652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.414939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.415215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.455730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] MFA Rules not processed for user `8713cb23a93147f8b52f88e240c81d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:52.457297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:52.467379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1148/2279] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:52.469825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.470257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.470673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.526881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] MFA Rules not processed for user `b80cf106031e412e9a68467c82ecb498`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:52.529358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:52.544238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1132/2280] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:52.545676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.631912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:52.647826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1149/2281] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:52.654618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.687408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba47b41-b1e1-44a1-afba-0593b02f98a2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.763666 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801075c-12d2-4dee-a0c5-4d544d6c6793 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.769373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.770183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.770535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.770879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.771678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.773787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.794584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.795975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.796569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.797028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.797971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.800932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:52.823954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1150/2282] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:52.833895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.838840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1133/2283] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:52.843938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:52.864941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dce66-1bb3-42ba-a74b-377921f8cb23 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.893387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:52.957090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2453c-6872-4ef5-854a-ac6d334846a2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:52.964152 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:52.965502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:52.965787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:52.966214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:52.967186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:52.969960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.017233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1151/2284] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:52 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:53.021221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.022377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.022754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.022913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.023248 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.024564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.032022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.054864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1134/2285] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:53.060203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.068174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b413c8-2c0c-4005-8994-55f2c9be8df8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.080597 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.088033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.088033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.088033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.088033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.088033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.088566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624449e2-96ec-4183-9d44-91be17b18dda admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.101616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.102463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.102796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.103148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.104335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.106479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.112038 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1152/2286] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:53.116783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.127256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1135/2287] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:53.135084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.150220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d5bbc-dd92-412c-a79c-0f8e049f5665 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.157553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea66a4-768f-4295-9456-fc505236b670 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.162745 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.164515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.165148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.165273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.165708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] PATH_INFO: `/v3/projects/c1c4677856a6459f8cbfa6f263179a68/users/852fd6c58c96478a8ff16fa194ad8c55/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.166534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.167122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.167677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] PATH_INFO: `/v3/projects/92e178bc727f4686bbd651560d7ff512/users/f187440691b04d81b2a6857b8958d055/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.200542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e178bc727f4686bbd651560d7ff512, user_id=f187440691b04d81b2a6857b8958d055, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.202572 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c4677856a6459f8cbfa6f263179a68, user_id=852fd6c58c96478a8ff16fa194ad8c55, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.205803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.208114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ece86-b90c-4482-bc39-74b07ba3bf85 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.231138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1153/2288] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:53 2022] PUT /identity/v3/projects/c1c4677856a6459f8cbfa6f263179a68/users/852fd6c58c96478a8ff16fa194ad8c55/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:53.232672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.240053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1136/2289] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:53 2022] PUT /identity/v3/projects/92e178bc727f4686bbd651560d7ff512/users/f187440691b04d81b2a6857b8958d055/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:53.268704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.268704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.268704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.321201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] MFA Rules not processed for user `f187440691b04d81b2a6857b8958d055`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:53.324430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:53.358375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:53.373000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee865e-d3f4-46b7-9e0c-7372a3b1390a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.481782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1137/2290] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:53.486722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.504796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.506929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.507915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.508862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.511357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.516732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.546800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1154/2291] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:53.549205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.582878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf51c6-14ee-447f-a8c0-62fdab846e90 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.597391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.600739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.601547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.602544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] PATH_INFO: `/v3/projects/c1c4677856a6459f8cbfa6f263179a68/users/852fd6c58c96478a8ff16fa194ad8c55/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.607016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c4677856a6459f8cbfa6f263179a68, user_id=852fd6c58c96478a8ff16fa194ad8c55, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.613444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a479e7-7a72-4060-bc20-6b83b3e2fdfc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.617016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a8b16-546b-4bfb-ba21-1def99f86cc3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.623723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.624765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.625063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.625385 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.626054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.628504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.647175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1155/2292] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:53 2022] PUT /identity/v3/projects/c1c4677856a6459f8cbfa6f263179a68/users/852fd6c58c96478a8ff16fa194ad8c55/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:53.658686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.659139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.659583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.667400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:53.672126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1138/2293] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:53 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:53.673552 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.730594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] MFA Rules not processed for user `852fd6c58c96478a8ff16fa194ad8c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:53.732968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:53.791924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7742e-4263-443e-b2a5-44ae395bddba admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.799168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.800505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.800826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.801288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.802044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.816673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.872671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1139/2294] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:53 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:53.873438 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.892121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08babdd-00e5-4ddf-b7d5-2664787eb5da admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.897587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.898478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.899694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.899694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.899973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.902392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.909654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1156/2295] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:06:53.920284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.921794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:53.922452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1140/2296] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:53.928393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:53.945002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d374a-042f-43c6-89bc-b63d5f3e1027 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:53.961968 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:53.962917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:53.963202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:53.963488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] PATH_INFO: `/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d/users/42b9019193174ec9a7fb240c56338dbe/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:53.984263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d2c81dcb25493c9e7a1bb54bbdf75d, user_id=42b9019193174ec9a7fb240c56338dbe, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:53.987345 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:53.992853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:54.015945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1141/2297] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:53 2022] PUT /identity/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d/users/42b9019193174ec9a7fb240c56338dbe/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:54.020917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:54.089247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bf124-252a-4932-a0e3-d66b1925f17b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:54.159676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91094-8e8b-4696-838b-419224ebedd6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:54.167866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:54.168629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:54.168915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:54.169191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:54.172679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:54.174617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:54.189346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1142/2298] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:06:54.194186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:54.208594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7efe-6581-45fa-abc0-a70a3142a132 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:54.212603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:54.213332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:54.213697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:54.214030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:54.216446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:54.218154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:54.218886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:54.219430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] PATH_INFO: `/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d/users/42b9019193174ec9a7fb240c56338dbe/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:54.223155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d2c81dcb25493c9e7a1bb54bbdf75d, user_id=42b9019193174ec9a7fb240c56338dbe, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:54.227168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4440b-6b51-4e27-aab1-ea7ef83773f2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:54.245157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1143/2299] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:54 2022] PUT /identity/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d/users/42b9019193174ec9a7fb240c56338dbe/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:54.257129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:54.257575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:54.260798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:54.309719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] MFA Rules not processed for user `42b9019193174ec9a7fb240c56338dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:54.310929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:54.378889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:54.387621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:54.390576 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:54.410096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1157/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:06:54.487415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1144/2301] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:54.490632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:54.507217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983c96-9403-485d-a23b-74af46c17297 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:54.588206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:54.589919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:54.590204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:54.590479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:54.683472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:54.685271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef483e-408c-45b4-8279-49888c39a89c service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:54.702560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1158/2302] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:55.887056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:55.976960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65f6d-8ff9-4b2f-b9e6-4d0dc4f5eea9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:55.982806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:55.983711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:55.984007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:55.984281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] PATH_INFO: `/v3/users/b80cf106031e412e9a68467c82ecb498` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:55.985701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80cf106031e412e9a68467c82ecb498)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:55.988134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:55.991418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:56.046878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80cf106031e412e9a68467c82ecb498'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.067047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80cf106031e412e9a68467c82ecb498'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.091766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80cf106031e412e9a68467c82ecb498'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.102782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80cf106031e412e9a68467c82ecb498'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.103675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80cf106031e412e9a68467c82ecb498'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.110764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1145/2303] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:55 2022] DELETE /identity/v3/users/b80cf106031e412e9a68467c82ecb498 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:56.115400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:56.115974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:56.115974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:56.135663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:56.137713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:56.216414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1159/2304] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:56.222998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:56.224478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:56.288746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e534ea-f3a4-4fd0-bcc5-9a61291fc1f7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:56.296991 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:56.297797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:56.298155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:56.298503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:56.310807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:56.312442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:56.323273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1146/2305] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:56.447037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:56.449504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:56.532413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:56.542333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c78bf-6154-4e29-9523-b1b96a89af5d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:56.551730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:56.552653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:56.552992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:56.553325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:56.555746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:56.671166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:56.672926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:56.684412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1160/2306] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:56.806234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:56.808038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:56.822432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8aa70-79b4-461b-bdd7-6bb6e1d220ba service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:56.827886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:56.829207 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:56.829529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:56.829950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] PATH_INFO: `/v3/projects/90e9b14593dd4ef4a1a44e60599c661b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:56.831265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e9b14593dd4ef4a1a44e60599c661b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:56.833612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:56.955323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e9b14593dd4ef4a1a44e60599c661b', 'request_id': 'req-16a3fae0-e1a4-4546-9b57-f58c215b12ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.980388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e9b14593dd4ef4a1a44e60599c661b', 'request_id': 'req-16a3fae0-e1a4-4546-9b57-f58c215b12ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:56.999511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e9b14593dd4ef4a1a44e60599c661b', 'request_id': 'req-16a3fae0-e1a4-4546-9b57-f58c215b12ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.027328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] The token cache is being invalidate because project 90e9b14593dd4ef4a1a44e60599c661b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:57.028393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.030809 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.035348 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1147/2307] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:56 2022] DELETE /identity/v3/projects/90e9b14593dd4ef4a1a44e60599c661b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:06:57.038869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:57.065162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c932d-d878-4067-9884-ce83b35d0748 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:57.175292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:57.181592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:57.181592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:57.181592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] PATH_INFO: `/v3/users/852fd6c58c96478a8ff16fa194ad8c55` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:57.181592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852fd6c58c96478a8ff16fa194ad8c55)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:57.186347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:57.262136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852fd6c58c96478a8ff16fa194ad8c55'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.288629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852fd6c58c96478a8ff16fa194ad8c55'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.312902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852fd6c58c96478a8ff16fa194ad8c55'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.316644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852fd6c58c96478a8ff16fa194ad8c55'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.328475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852fd6c58c96478a8ff16fa194ad8c55'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.338832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1161/2308] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:06:57 2022] DELETE /identity/v3/users/852fd6c58c96478a8ff16fa194ad8c55 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:57.618458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:57.620837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:57.631742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:57.697544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3fae0-e1a4-4546-9b57-f58c215b12ab admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:57.778483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:57.780027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:57.781090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:57.782191 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:57.782671 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:57.783361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:57.786052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:57.843973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:57.889613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:57.895860 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47530d3-a518-4208-a1e1-079feda51424 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:57.896587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c038f4b-74fb-4914-934c-1d2a7d0f68d8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:57.908037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:57.908037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:57.908037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:57.908037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] PATH_INFO: `/v3/projects/c1c4677856a6459f8cbfa6f263179a68` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:57.910747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c4677856a6459f8cbfa6f263179a68)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:57.912758 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:57.918354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1148/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:06:57.975079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c4677856a6459f8cbfa6f263179a68', 'request_id': 'req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.984868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c4677856a6459f8cbfa6f263179a68', 'request_id': 'req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:57.992647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c4677856a6459f8cbfa6f263179a68', 'request_id': 'req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:58.013810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] The token cache is being invalidate because project c1c4677856a6459f8cbfa6f263179a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:06:58.014092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:58.014808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e89a9ecc-d4f2-4110-8ccf-155b50efdb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:06:58.025539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.026110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1162/2310] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:06:57 2022] DELETE /identity/v3/projects/c1c4677856a6459f8cbfa6f263179a68 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:58.026206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.031201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.100864 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:58.102261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:58.243718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1149/2311] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:58.256273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.257588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.257588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.279848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:58.281646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:58.295201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.295962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1163/2312] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:58.318282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ce37-6d76-417d-92d8-3c15154ac1e5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.325521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.326127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.327052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.327052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.328016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:06:58.328465 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.331120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.358353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:58.365820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1150/2313] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:06:58.372412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.383233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0600c1-8674-483d-b47b-5e750b468c2e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.390690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.391505 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.391789 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.392153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.392965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.395448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.441913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1164/2314] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:06:58 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:06:58.452040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.466553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28ea7e-ec75-4c49-8b8d-b3917c6ce881 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.543137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.543953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.544341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.544689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.545520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.547600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.571504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1151/2315] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:06:58 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:06:58.576774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.588156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb697-9bf0-4934-86d6-5e089213388f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.594432 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.595354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.595640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.595915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.596701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.598338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.612229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1165/2316] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:58.618501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.639216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ca62-d609-4c37-aef4-1534c8722901 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.649157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.650018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.650366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.650742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.652162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.662938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baffba-de4d-4698-bf47-55ddb04144c7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.677764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1152/2317] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:06:58.685133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.699212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3da95-f7df-496e-a86a-eab80fa17488 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:58.706632 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:58.707622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.708295 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.709243 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] PATH_INFO: `/v3/projects/a5633af5fdeb4a9782f93d20a461e411/users/531b2794011c4214a0d2bb2b1d9e6023/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.737976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5633af5fdeb4a9782f93d20a461e411, user_id=531b2794011c4214a0d2bb2b1d9e6023, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:58.741964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:58.761448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1166/2318] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:06:58 2022] PUT /identity/v3/projects/a5633af5fdeb4a9782f93d20a461e411/users/531b2794011c4214a0d2bb2b1d9e6023/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:06:58.774163 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:58.774453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:58.774725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:58.808049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] MFA Rules not processed for user `531b2794011c4214a0d2bb2b1d9e6023`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:06:58.808688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:58.944288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1153/2319] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:06:58.956444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:06:58.958482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:06:59.065290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:59.070613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac498d2c-c1e9-4334-a4c9-8714c8640f70 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:06:59.107915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:06:59.109191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:06:59.110193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:06:59.110193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:06:59.143819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:06:59.146499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeceb03-76de-427f-a069-24dc4822b5e7 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:06:59.176130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1167/2320] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:02.722876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:02.724800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:02.808525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9887d9-8dda-4dfa-b5d2-a81ec1ea3ded None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:02.813267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:02.814173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:02.814453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:02.814721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] PATH_INFO: `/v3/users/daa38b0f350f4fbcaab42839491a2f8d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:02.815943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa38b0f350f4fbcaab42839491a2f8d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:02.818057 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:02.830654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:02.876087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa38b0f350f4fbcaab42839491a2f8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:02.891462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa38b0f350f4fbcaab42839491a2f8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:02.909304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa38b0f350f4fbcaab42839491a2f8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:02.922747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa38b0f350f4fbcaab42839491a2f8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:02.923520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa38b0f350f4fbcaab42839491a2f8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:02.929999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1154/2321] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:02 2022] DELETE /identity/v3/users/daa38b0f350f4fbcaab42839491a2f8d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:07:02.935256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:02.935807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:02.936095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:02.956168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:02.957393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:03.043762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1168/2322] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:03.061193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:03.062725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:03.134015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a394b-d45a-4ba0-9415-b542fecc551f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:03.138100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:03.138775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:03.139051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:03.139320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:03.150959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:03.152821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:03.163972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1155/2323] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:03.559889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:03.562223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:03.585119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d478e1a-6cd3-4865-9b01-012ce93e7e96 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:03.593762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:03.595274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:03.595757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:03.596269 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] PATH_INFO: `/v3/projects/5bd3d12aaf9542819a88a5ce5df43d2f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:03.598412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd3d12aaf9542819a88a5ce5df43d2f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:03.602097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:03.684148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd3d12aaf9542819a88a5ce5df43d2f', 'request_id': 'req-92e7a874-0f4b-4c26-b8a5-1e30113d3729'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:03.693157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd3d12aaf9542819a88a5ce5df43d2f', 'request_id': 'req-92e7a874-0f4b-4c26-b8a5-1e30113d3729'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:03.703050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd3d12aaf9542819a88a5ce5df43d2f', 'request_id': 'req-92e7a874-0f4b-4c26-b8a5-1e30113d3729'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:03.722642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] The token cache is being invalidate because project 5bd3d12aaf9542819a88a5ce5df43d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:07:03.723110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:03.724078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:03.726058 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1169/2324] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:03 2022] DELETE /identity/v3/projects/5bd3d12aaf9542819a88a5ce5df43d2f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:03.731211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:03.743584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453ee2-7937-449a-9e4b-5e196c211dff service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:03.862063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:03.864206 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:03.865101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:03.865798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] PATH_INFO: `/v3/users/f187440691b04d81b2a6857b8958d055` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:03.868201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f187440691b04d81b2a6857b8958d055)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:03.871845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:03.941646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:03.975751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f187440691b04d81b2a6857b8958d055'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.008785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f187440691b04d81b2a6857b8958d055'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.024023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f187440691b04d81b2a6857b8958d055'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.042904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f187440691b04d81b2a6857b8958d055'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.048099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f187440691b04d81b2a6857b8958d055'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.085801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1156/2325] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:03 2022] DELETE /identity/v3/users/f187440691b04d81b2a6857b8958d055 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:07:04.436967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:04.439478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:04.474549 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7a874-0f4b-4c26-b8a5-1e30113d3729 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:04.571372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:04.572626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:04.573318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:04.574232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] PATH_INFO: `/v3/projects/92e178bc727f4686bbd651560d7ff512` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:04.579078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e178bc727f4686bbd651560d7ff512)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:04.583397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:04.614685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:04.655640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e178bc727f4686bbd651560d7ff512', 'request_id': 'req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.662809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e178bc727f4686bbd651560d7ff512', 'request_id': 'req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.670539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e178bc727f4686bbd651560d7ff512', 'request_id': 'req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.686851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] The token cache is being invalidate because project 92e178bc727f4686bbd651560d7ff512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:07:04.687138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.687844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.689513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1170/2326] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:04 2022] DELETE /identity/v3/projects/92e178bc727f4686bbd651560d7ff512 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:04.693685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:04.695195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:04.715266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ebfd-53d7-42b2-9533-0381ff304c80 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:04.784735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:04.785648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:04.785933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:04.786203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] PATH_INFO: `/v3/users/42b9019193174ec9a7fb240c56338dbe` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:04.787463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b9019193174ec9a7fb240c56338dbe)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:04.789459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:04.873440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b9019193174ec9a7fb240c56338dbe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.887770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b9019193174ec9a7fb240c56338dbe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.897165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b9019193174ec9a7fb240c56338dbe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.906200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b9019193174ec9a7fb240c56338dbe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.907014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d219c6b1-b0d8-4d99-808c-42e942c4fc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b9019193174ec9a7fb240c56338dbe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:04.913878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1157/2327] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:04 2022] DELETE /identity/v3/users/42b9019193174ec9a7fb240c56338dbe => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:05.346055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.348222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:05.365937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0f3e3-e0c7-48e8-88dd-bee5fa774162 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:05.439429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:05.440634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.440918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.441195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] PATH_INFO: `/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.442566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d2c81dcb25493c9e7a1bb54bbdf75d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:05.444540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:05.511533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d2c81dcb25493c9e7a1bb54bbdf75d', 'request_id': 'req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:05.511533 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d2c81dcb25493c9e7a1bb54bbdf75d', 'request_id': 'req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:05.516761 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d2c81dcb25493c9e7a1bb54bbdf75d', 'request_id': 'req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:05.530869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] The token cache is being invalidate because project 62d2c81dcb25493c9e7a1bb54bbdf75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:07:05.531187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:05.532096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e4b3471-ea6c-49e9-bfa7-b41829bb83f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:05.533723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1171/2328] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:05 2022] DELETE /identity/v3/projects/62d2c81dcb25493c9e7a1bb54bbdf75d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:05.539673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355886-8484-4540-beb2-f469588c1e2b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.540083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355886-8484-4540-beb2-f469588c1e2b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.540610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355886-8484-4540-beb2-f469588c1e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.560754 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-69355886-8484-4540-beb2-f469588c1e2b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:05.561996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-69355886-8484-4540-beb2-f469588c1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:05.588183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:05.653295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1158/2329] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:05.661834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.662117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.662394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.682316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:05.683783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:05.692601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1172/2330] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:05.697602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355886-8484-4540-beb2-f469588c1e2b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.709376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355886-8484-4540-beb2-f469588c1e2b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:05.714767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:05.715640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.715922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.716228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.717015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:07:05.717311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:05.718956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:05.738655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1159/2331] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:07:05.740149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.753105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304088c-eb86-46c7-ac81-e4be3b35f85f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:05.760985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:05.762196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.762755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.763213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.764494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:05.768142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:05.803768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1173/2332] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:07:05 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:07:05.809073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.820472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949db04-8c64-4e36-9c96-c571f56f0c00 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:05.905454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:05.906240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.906489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.906795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.907524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:05.909752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:05.938788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1160/2333] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:07:05 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:07:05.942995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.954030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106e26-e099-4308-a58c-e3aa2b2bbc8a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:05.958847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:05.959672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:05.960061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:05.960203 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:05.960961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:05.962623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:05.964437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:05.979676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1174/2334] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:07:05.980689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:05.998649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2265fe-e329-4b1c-9b57-250c014aa7a8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:06.004706 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:06.005474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:06.005752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:06.006463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:06.006792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:06.008480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3c91-c364-4c26-9958-372863f51dd1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:06.025271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1161/2335] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:07:06.029502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:06.047361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5c07-f134-4582-9810-1b35197c809b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:06.055621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:06.057255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:06.057767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:06.058587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] PATH_INFO: `/v3/projects/5a68679e2b3544bbb82f944fcae970ef/users/36e865c93d844d8aa23661f779cd8e60/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:06.078355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a68679e2b3544bbb82f944fcae970ef, user_id=36e865c93d844d8aa23661f779cd8e60, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:06.081451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:06.103299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1175/2336] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:07:06 2022] PUT /identity/v3/projects/5a68679e2b3544bbb82f944fcae970ef/users/36e865c93d844d8aa23661f779cd8e60/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:06.111694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fbff-f934-4873-b133-10843698c172 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:06.112187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fbff-f934-4873-b133-10843698c172 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:06.112662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54fbff-f934-4873-b133-10843698c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:06.141852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4a54fbff-f934-4873-b133-10843698c172 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:06.143787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4a54fbff-f934-4873-b133-10843698c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:06.228021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1162/2337] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:06.238919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:06.241647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:06.327673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe070-6510-496b-badc-3762b3c4584a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:06.334374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:06.335539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:06.336081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:06.336601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:06.352367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:06.353855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:06.365713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1176/2338] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:07.158661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e65f3-3d54-4ee7-a1b6-66981711836c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:07.160836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e65f3-3d54-4ee7-a1b6-66981711836c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:07.161691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e65f3-3d54-4ee7-a1b6-66981711836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:07.217643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9b9e65f3-3d54-4ee7-a1b6-66981711836c None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:07.218901 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9b9e65f3-3d54-4ee7-a1b6-66981711836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:07.269297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:07.338620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1163/2339] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:07:07.404188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:07.406593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:07.494640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834434c9-c8e4-47a5-a5f6-35490ca457fd service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:07.503334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:07.504756 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:07.505450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:07.506443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:07.520656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:07.522883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b000-1bab-46ae-841b-0741ea57a70a service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:07.533259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1177/2340] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:07:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 06 21:07:09.125629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:09.127278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:09.127883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:09.191654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] MFA Rules not processed for user `67481128d30049d29d5f0e66b1a4c970`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:09.193604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:09.393312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1164/2341] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:15.298619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e8c3-5ab8-4fb1-aac1-a46e3eda21e4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:15.300241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e8c3-5ab8-4fb1-aac1-a46e3eda21e4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:15.300923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e8c3-5ab8-4fb1-aac1-a46e3eda21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:15.350707 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9c21e8c3-5ab8-4fb1-aac1-a46e3eda21e4 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:15.353440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c21e8c3-5ab8-4fb1-aac1-a46e3eda21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:15.371092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1178/2342] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:15.422287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:15.491705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9e6d0-7ab2-4b1d-b27b-cf7c79f38d57 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:15.543155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:15.543847 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:15.544178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:15.544457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:15.558987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:15.561822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:15.622978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1165/2343] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:07:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:07:21.466238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:21.466921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:21.467181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:21.611439 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] MFA Rules not processed for user `36e865c93d844d8aa23661f779cd8e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:21.614501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:21.823391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:21.890198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1179/2344] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:21.894999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:21.940721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1db2-0ea8-436e-bd11-d1efcaacaa2e service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:21.969121 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:21.973728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:21.974011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:21.982374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:21.988712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:22.018719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:22.219691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1166/2345] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:07:21 2022] POST /identity/v3/projects => generated 371 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:07:22.221580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:22.248307 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c72cd-1734-42cc-a59b-6bb8a8bd51a3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:22.553478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:22.570971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:22.573041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:22.573807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:22.575581 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:22.581783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:22.642299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1180/2346] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:07:22 2022] POST /identity/v3/users => generated 292 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:07:22.645493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:22.667316 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84a0d-b193-4b46-8f9a-ba0ffb1ae489 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:22.694067 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:22.695059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:22.695506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:22.695960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:22.703407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:22.705779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:22.743255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1167/2347] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:07:22.747217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:22.770460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2512f-7952-4185-93d8-e65573e88cdb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:22.793366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:22.794792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:22.795483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:22.796126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] PATH_INFO: `/v3/projects/6543932205344b25b661cbe17cee7b6d/users/137d3450d0e94eb4b177ea781b65ded5/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:22.847643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6543932205344b25b661cbe17cee7b6d, user_id=137d3450d0e94eb4b177ea781b65ded5, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:22.860175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:22.903816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1181/2348] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:07:22 2022] PUT /identity/v3/projects/6543932205344b25b661cbe17cee7b6d/users/137d3450d0e94eb4b177ea781b65ded5/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:22.909778 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:22.925750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b1b9-a60a-48ae-a0e5-afee789e1df8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:23.081488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:23.089594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:23.089971 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:23.090159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:23.090934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:23.092730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:23.116164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1168/2349] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:07:23.122027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:23.144201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a509b3-cbe1-4060-9eaa-53ed6024383a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:23.162599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:23.163552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:23.163836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:23.164133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] PATH_INFO: `/v3/projects/6543932205344b25b661cbe17cee7b6d/users/137d3450d0e94eb4b177ea781b65ded5/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:23.170180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6543932205344b25b661cbe17cee7b6d, user_id=137d3450d0e94eb4b177ea781b65ded5, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:23.179929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f02f-e61c-4581-a7ed-bfe4e86e0e8e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:23.235091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1182/2350] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:07:23 2022] PUT /identity/v3/projects/6543932205344b25b661cbe17cee7b6d/users/137d3450d0e94eb4b177ea781b65ded5/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:32.352443 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:32.354777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:32.450448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:32.600989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d067c87-2fdf-487c-ac48-edeb288b36f9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:32.717592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:32.718355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:32.718759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:32.719133 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:32.723510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:32.754274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:32.756139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:32.785254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1169/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:33.197619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=50,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:40.302544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:40.303762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:40.304224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:40.356602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] MFA Rules not processed for user `137d3450d0e94eb4b177ea781b65ded5`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:40.359130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:40.364895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:40.367562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:40.463236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4813-0136-4832-9451-dfdf984f4d44 service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:40.467431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:40.468423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:40.468933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:40.469393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:40.472490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:40.526458 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1183/2352] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:40.540658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:40.542151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:40.564075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:40.602773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:40.605813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168d79d-1503-4e8e-89d3-a9fe2b307872 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:40.634752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1170/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:40.807055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daffd01-140f-437a-bb4f-6e3a379a9e2d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:40.807055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:40.807055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:40.807055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:40.856781 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:41.146084 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:41.150998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:41.193948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1184/2354] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:07:43.663454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290b1fb-219d-40f5-a22f-a8f3a0ceb22b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:43.664134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290b1fb-219d-40f5-a22f-a8f3a0ceb22b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:43.664134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290b1fb-219d-40f5-a22f-a8f3a0ceb22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:43.734502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2290b1fb-219d-40f5-a22f-a8f3a0ceb22b None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:43.736285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2290b1fb-219d-40f5-a22f-a8f3a0ceb22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:43.905816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1171/2355] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:43.927305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:43.941336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:44.109344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2fab-e754-450c-a340-01d6a6997e14 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:44.109929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2fab-e754-450c-a340-01d6a6997e14 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:44.110367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2fab-e754-450c-a340-01d6a6997e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:44.125511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16758354-56d7-4faf-9cae-60cb206d363a service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:44.131344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:44.132048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:44.132335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:44.132612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:44.142995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:44.144859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b6f61-03fa-408e-9c8d-f98331699d5f service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:44.157958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1185/2356] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:07:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:07:44.169928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-894b2fab-e754-450c-a340-01d6a6997e14 None None] MFA Rules not processed for user `36e865c93d844d8aa23661f779cd8e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:44.176459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-894b2fab-e754-450c-a340-01d6a6997e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:44.196822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1172/2357] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:07:46.141570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.142092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.142092 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.143880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1186/2358] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:07:46.165331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850734c-4bf8-4708-b1ad-f89249b524f2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.165932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850734c-4bf8-4708-b1ad-f89249b524f2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.165932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850734c-4bf8-4708-b1ad-f89249b524f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.298000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c850734c-4bf8-4708-b1ad-f89249b524f2 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:46.299953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c850734c-4bf8-4708-b1ad-f89249b524f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:46.313428 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1173/2359] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:07:46.333146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:46.335787 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:46.530119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3ef5-7040-45f7-bb41-49f3b15cb652 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:46.538249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:46.538936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.539227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.539506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.556979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:46.557978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568244c4-b0b5-4100-ad25-9453e89726df service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:46.572557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1187/2360] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:46.656935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df1ae-51dd-49e8-ac29-579a77dfa9a6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.657346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df1ae-51dd-49e8-ac29-579a77dfa9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.657686 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df1ae-51dd-49e8-ac29-579a77dfa9a6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.659728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1174/2361] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:07:46.667859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f0ef-08c6-49e9-a5a9-e0c58345c283 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.668224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f0ef-08c6-49e9-a5a9-e0c58345c283 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.668744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f0ef-08c6-49e9-a5a9-e0c58345c283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.737184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bc54f0ef-08c6-49e9-a5a9-e0c58345c283 None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:46.738703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bc54f0ef-08c6-49e9-a5a9-e0c58345c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:46.755051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1188/2362] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:07:46.774850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df1ae-51dd-49e8-ac29-579a77dfa9a6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:46.792772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df1ae-51dd-49e8-ac29-579a77dfa9a6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:46.799744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:46.800489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.800772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.801053 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.820726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:46.822298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6e13-bbcd-4af1-874d-b246004c1ca0 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:46.839569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1175/2363] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:46.994724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:46.995014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:46.995389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:46.999091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1189/2364] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:07:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 21:07:47.015265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:47.015265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:47.015265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:47.032374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:47.034740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:47.041253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:47.042201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:47.058782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1176/2365] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:47.070045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:47.085918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f204b-fcd6-4eb7-afcd-8abe5abe0a9c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:47.092043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:47.093352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:47.093828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:47.094285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:47.109543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:47.111018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:47.124170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1177/2366] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:07:47.138842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce8b7e-2f45-47b2-baf0-b1c02f4bfd0e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:47.144210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:47.145202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:47.145389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:47.145652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] PATH_INFO: `/v3/users/101810e54c274bf48c3cab586d24e764` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:47.147016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101810e54c274bf48c3cab586d24e764)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:47.148983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:47.151137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:47.210879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101810e54c274bf48c3cab586d24e764'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.219699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101810e54c274bf48c3cab586d24e764'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.236179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101810e54c274bf48c3cab586d24e764'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.237343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101810e54c274bf48c3cab586d24e764'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.253960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-20835a9c-8654-4b7b-8667-3a3b5451af73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101810e54c274bf48c3cab586d24e764'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.264714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1190/2367] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:47 2022] DELETE /identity/v3/users/101810e54c274bf48c3cab586d24e764 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:07:47.493889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:47.511649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f90a-bb04-45d3-8604-b16c7ff3ab01 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:47.592391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:47.601956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:47.603760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:47.604134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:47.604452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] PATH_INFO: `/v3/projects/f1a72d23da2148c598c119821ec8a513` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:47.605774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a72d23da2148c598c119821ec8a513)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:47.607750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:47.671555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a72d23da2148c598c119821ec8a513', 'request_id': 'req-03a106ae-d490-42a5-9148-71c62cea3672'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.678967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a72d23da2148c598c119821ec8a513', 'request_id': 'req-03a106ae-d490-42a5-9148-71c62cea3672'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.685124 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a72d23da2148c598c119821ec8a513', 'request_id': 'req-03a106ae-d490-42a5-9148-71c62cea3672'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.700537 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] The token cache is being invalidate because project f1a72d23da2148c598c119821ec8a513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:07:47.700828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.701495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:47.703683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1178/2368] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:47 2022] DELETE /identity/v3/projects/f1a72d23da2148c598c119821ec8a513 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:52.757421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:52.757924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:52.758444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:52.794920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:52.797103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:52.893952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1191/2369] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:52.909094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:52.910601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:53.022224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a106ae-d490-42a5-9148-71c62cea3672 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:53.033776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:53.035306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:53.035616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:53.035874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:53.048034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:53.050705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f07d39-bdf1-4e77-bc48-0e422fc55b2d service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:53.061746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1179/2370] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:07:57.122637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:57.125115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:57.201290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6182-9355-4c5d-a80b-6abc09a2471c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:57.207136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:57.208075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:57.208362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:57.208638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] PATH_INFO: `/v3/users/531b2794011c4214a0d2bb2b1d9e6023` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:57.209927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531b2794011c4214a0d2bb2b1d9e6023)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:57.211859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:57.244751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:57.270578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531b2794011c4214a0d2bb2b1d9e6023'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:57.278201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531b2794011c4214a0d2bb2b1d9e6023'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:57.304246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531b2794011c4214a0d2bb2b1d9e6023'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:57.310079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531b2794011c4214a0d2bb2b1d9e6023'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:57.324759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531b2794011c4214a0d2bb2b1d9e6023'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:57.334157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1192/2371] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:57 2022] DELETE /identity/v3/users/531b2794011c4214a0d2bb2b1d9e6023 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:57.339095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:57.339823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:57.340272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:57.359102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:57.360360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:57.434888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1180/2372] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:07:57.445044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:57.446594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:57.512820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c2fc-e797-419e-ba92-219982d1f795 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:57.516823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:57.517629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:57.517920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:57.518196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:57.529919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:57.531402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0006fb-e3b7-4b73-97f5-bfee6a0d2d49 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:57.542302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1193/2373] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:07:58.063753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.066104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:58.077974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:58.092054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56f6b8-3fee-4948-9918-6dde624b422e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.102654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.105314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.106967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.107479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] PATH_INFO: `/v3/projects/a5633af5fdeb4a9782f93d20a461e411` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.110356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5633af5fdeb4a9782f93d20a461e411)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.114940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.215462 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5633af5fdeb4a9782f93d20a461e411', 'request_id': 'req-ea4180ac-7587-42c6-9ad6-c185e7634955'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:58.223367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5633af5fdeb4a9782f93d20a461e411', 'request_id': 'req-ea4180ac-7587-42c6-9ad6-c185e7634955'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:58.230733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5633af5fdeb4a9782f93d20a461e411', 'request_id': 'req-ea4180ac-7587-42c6-9ad6-c185e7634955'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:58.253780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] The token cache is being invalidate because project a5633af5fdeb4a9782f93d20a461e411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:07:58.254540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:58.255432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ea4180ac-7587-42c6-9ad6-c185e7634955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:58.257650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1181/2374] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:58 2022] DELETE /identity/v3/projects/a5633af5fdeb4a9782f93d20a461e411 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:07:58.265447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.266133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.266133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.294665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:58.296464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:58.368367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1194/2375] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:58.370145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.370641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.370793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.396926 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:58.398167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:58.413558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1182/2376] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:58.419220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.430167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8659f-4306-4114-89d9-72b38afb592b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.435651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.436387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.436668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.436945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.437692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:07:58.437988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.439619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.454740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1195/2377] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:07:58.459398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.469300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f902-0a47-48c5-91ab-5b9742706fb4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.474633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.475287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.475613 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.475880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.476624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.478539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.512922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1183/2378] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:07:58 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:07:58.517977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.529925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8581e-3acc-4fa8-91c7-50ad4e033b99 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.568136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:58.601461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.602153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.602441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.602726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.603411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.605817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.630523 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1196/2379] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:07:58 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:07:58.635081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.646698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb0f52-1d88-41c6-81c1-c958860445ef admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.652951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.653687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.653950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.654213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.655118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.656794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.673628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1184/2380] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:07:58.677981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.693971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cd487-d6a4-48eb-a343-31e813cf01f5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.700367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.701178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.701517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.701843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.702660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.704742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0289048-fe34-4f6c-acd0-2b0135a5584e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.716869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1197/2381] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:07:58.721157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:58.732635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0ca2-df5d-472b-a2ce-2a7c32b2f0e4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:58.738668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:58.739626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.740015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.740309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] PATH_INFO: `/v3/projects/bbce2aaa4f4b4a96a4c9ea85ed1c505f/users/d27e70a71abc4e76ab8c07f543483ad4/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.757612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbce2aaa4f4b4a96a4c9ea85ed1c505f, user_id=d27e70a71abc4e76ab8c07f543483ad4, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:58.760384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:58.776547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1185/2382] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:07:58 2022] PUT /identity/v3/projects/bbce2aaa4f4b4a96a4c9ea85ed1c505f/users/d27e70a71abc4e76ab8c07f543483ad4/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:07:58.850822 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:58.851130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:58.851360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:58.884353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] MFA Rules not processed for user `d27e70a71abc4e76ab8c07f543483ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:58.885564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:59.015342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1198/2383] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:59.028915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:59.030935 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:59.191072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29dee-456a-4fe2-ace7-f702f371e54a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:59.195723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:59.196469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:59.196841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:59.197182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:59.209035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:59.210506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b2d6f-a713-49f1-a374-a62ad3249d4f service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:59.223470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1186/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:07:59.254998 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:59.353419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5c6e9-3274-4493-8a69-614d879cb40a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:59.359751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:59.360870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:59.361231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:59.361564 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] PATH_INFO: `/v3/users/d27e70a71abc4e76ab8c07f543483ad4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:59.363074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27e70a71abc4e76ab8c07f543483ad4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:59.365221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:59.424943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:59.431181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27e70a71abc4e76ab8c07f543483ad4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:59.437599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27e70a71abc4e76ab8c07f543483ad4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:59.451303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27e70a71abc4e76ab8c07f543483ad4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:59.452114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27e70a71abc4e76ab8c07f543483ad4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:59.463016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27e70a71abc4e76ab8c07f543483ad4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:07:59.473896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1199/2385] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:07:59 2022] DELETE /identity/v3/users/d27e70a71abc4e76ab8c07f543483ad4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:07:59.478702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:59.479267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:59.479267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:59.492503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:59.504379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:07:59.506657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:59.570764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1187/2386] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:07:59.582142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:59.583650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:59.645540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd2b0-3eb5-4583-ad11-9183e755eeec admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:59.651363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:59.652621 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:07:59.653001 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:07:59.653451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:07:59.667851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:07:59.669348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e818c9-9302-4377-b086-855c1c6ab4d8 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:07:59.679818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1200/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:07:59.970476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:07:59.971937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:07:59.985568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae306d1-407e-4706-be52-22f8b1f30935 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:07:59.998702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:07:59.999756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.000220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.000542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] PATH_INFO: `/v3/projects/bbce2aaa4f4b4a96a4c9ea85ed1c505f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.002035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbce2aaa4f4b4a96a4c9ea85ed1c505f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.004405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.058576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbce2aaa4f4b4a96a4c9ea85ed1c505f', 'request_id': 'req-932e844a-d2d4-4038-8fdf-136faf1f681c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:08:00.065839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbce2aaa4f4b4a96a4c9ea85ed1c505f', 'request_id': 'req-932e844a-d2d4-4038-8fdf-136faf1f681c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:08:00.078657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbce2aaa4f4b4a96a4c9ea85ed1c505f', 'request_id': 'req-932e844a-d2d4-4038-8fdf-136faf1f681c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:08:00.092764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] The token cache is being invalidate because project bbce2aaa4f4b4a96a4c9ea85ed1c505f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:08:00.093421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:08:00.093682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-932e844a-d2d4-4038-8fdf-136faf1f681c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:08:00.095854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1188/2388] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:07:59 2022] DELETE /identity/v3/projects/bbce2aaa4f4b4a96a4c9ea85ed1c505f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:08:00.100808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.101170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.101447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.120914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:00.122184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:00.215417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1201/2389] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:08:00.219402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.220064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.220408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.246619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:00.246619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:00.265575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1189/2390] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:00.275287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.287025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468a80-b91c-47fa-8521-becf8788a41c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.293889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.295557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.296594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.296594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.297073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:08:00.297491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.303815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.316196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1202/2391] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:08:00.320656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.333542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762afce-acdb-49db-a20c-1295f7e12bdb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.347475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.348297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.348913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.348913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.349877 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.352021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.414068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1190/2392] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:08:00 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:08:00.420040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.442454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6de28-5e00-434e-b011-6b72b123d0de admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.548529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:00.570700 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.571485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.571839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.572696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.573136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.575418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.605604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1203/2393] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:08:00 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:08:00.609532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.620672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d46615-c469-48ff-ac3e-e11216f0b778 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.626237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.627107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.627399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.627656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.628541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.630565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.644777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1191/2394] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:08:00.648922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.659941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62ba66-5550-40cf-8b0b-e5b6c9c103dd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.668978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.669701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.669984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.670263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.671010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.672715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d786d82-8511-4947-b7b1-7ce23e669bc0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.684423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1204/2395] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:08:00.689015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.701779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff34c14-8432-4390-ab02-31b2ee39c436 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.706978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.707895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.708190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.708472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] PATH_INFO: `/v3/projects/a00a423b890b4dc0b4410220da7cdaa8/users/3f74038b57aa477283f7c8fabebd19be/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.729044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00a423b890b4dc0b4410220da7cdaa8, user_id=3f74038b57aa477283f7c8fabebd19be, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.732022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.751480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1192/2396] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:08:00 2022] PUT /identity/v3/projects/a00a423b890b4dc0b4410220da7cdaa8/users/3f74038b57aa477283f7c8fabebd19be/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:08:00.757812 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab168924-a35e-4c25-b6f2-54cfde078d73 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.758109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab168924-a35e-4c25-b6f2-54cfde078d73 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.758444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab168924-a35e-4c25-b6f2-54cfde078d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.780118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ab168924-a35e-4c25-b6f2-54cfde078d73 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:00.781594 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ab168924-a35e-4c25-b6f2-54cfde078d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:00.861620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1205/2397] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:00.874729 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:00.876874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:00.916128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:00.959379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30e3a-139b-4281-9d71-3fef33dde20c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:00.963119 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:00.963796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:00.964160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:00.964439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:00.975134 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:00.976637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:00.997101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1193/2398] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:08:02.036116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1baaf-6459-415a-a63b-e2bb7822e918 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:02.036677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1baaf-6459-415a-a63b-e2bb7822e918 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:02.036677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1baaf-6459-415a-a63b-e2bb7822e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:02.070739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-88c1baaf-6459-415a-a63b-e2bb7822e918 None None] MFA Rules not processed for user `3f74038b57aa477283f7c8fabebd19be`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:02.072192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-88c1baaf-6459-415a-a63b-e2bb7822e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:02.148748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1206/2399] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:02.160136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:02.161624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:02.226870 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f5f0-86ee-4397-b5d0-7b91b1ba944b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:02.231446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:02.232154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:02.232504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:02.232776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:02.241787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:02.243221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a845d23-4b57-463f-8459-e2b013bed4e0 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:02.252684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1194/2400] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:08:03.617364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:03.617900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:03.618015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:03.638434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] MFA Rules not processed for user `3f74038b57aa477283f7c8fabebd19be`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:03.639783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:03.648846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1207/2401] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:12.248426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=40 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:13.631539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:24.853122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5194bc-a60f-48a6-8f81-2ff018262d86 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:24.854622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5194bc-a60f-48a6-8f81-2ff018262d86 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:24.855367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5194bc-a60f-48a6-8f81-2ff018262d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:24.885827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3b5194bc-a60f-48a6-8f81-2ff018262d86 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:24.888021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3b5194bc-a60f-48a6-8f81-2ff018262d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:24.985640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1195/2402] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:25.017346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:25.019017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:25.117884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074b8f-e0fd-4030-b554-4a985fb444fb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:25.124147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:25.124824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:25.125108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:25.125381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:25.136420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:25.138108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:25.146842 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1208/2403] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:08:30.184719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b4b3-80f9-46c4-b1e2-6d1d28e0a20c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:30.185284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b4b3-80f9-46c4-b1e2-6d1d28e0a20c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:30.185284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b4b3-80f9-46c4-b1e2-6d1d28e0a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:30.215664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c030b4b3-80f9-46c4-b1e2-6d1d28e0a20c None None] MFA Rules not processed for user `ab9da673f40b4e3eb541fdc380cfe282`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:30.216951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c030b4b3-80f9-46c4-b1e2-6d1d28e0a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:30.286823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1196/2404] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:32.325509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:08:32.344708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933d5f-ed51-4f6d-9017-fc77d866e71d service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:08:32.352023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:08:32.353267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:32.353833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:32.354381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:32.357708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:32.459202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:08:32.461026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24725dec-cb40-4655-8f74-3b064d50eea0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:08:32.472660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1209/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:08:36.417376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6854a9-4974-4fd4-884f-9b909b17144c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:08:36.418068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6854a9-4974-4fd4-884f-9b909b17144c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:08:36.418194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6854a9-4974-4fd4-884f-9b909b17144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:08:36.438703 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0e6854a9-4974-4fd4-884f-9b909b17144c None None] MFA Rules not processed for user `8713cb23a93147f8b52f88e240c81d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:08:36.440103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0e6854a9-4974-4fd4-884f-9b909b17144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:08:36.506484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1197/2406] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:08:42.467863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=62 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:46.497195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=75 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:24.671210 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:24.671924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:24.671924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:24.692521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] MFA Rules not processed for user `3f74038b57aa477283f7c8fabebd19be`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:09:24.693907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:24.701246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1210/2407] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:09:29.081097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:29.081679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:29.081793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:29.101551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] MFA Rules not processed for user `602aaa469bed4617b1a0385087066c93`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:09:29.102851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:29.167393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1198/2408] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:09:29.283270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:09:29.284926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:29.298920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134103c8-79bd-4bb7-bafd-b5e38875f9c0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:09:29.303443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:09:29.304184 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:29.304689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:29.304972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:29.307206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:29.388553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:09:29.390182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:09:29.403529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1211/2409] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:09:31.793202 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:09:31.803563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01970-4d07-4e04-8ad3-39672a6d494a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:09:31.807548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:09:31.808502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:31.808775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:31.809219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:31.811534 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:31.829531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:09:31.830974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:09:31.844862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1199/2410] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:09:39.397965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=37 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:41.838372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=31 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:53.672943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:09:53.688294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea15e1f-1260-4c51-beaa-4f0043fdcd33 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:09:53.695025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:09:53.696241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:53.697819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:53.697819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:53.700950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:53.722601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:09:53.724168 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9c7d8-3168-4313-a04f-ac6f7bb142df service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:09:53.739166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1212/2411] 10.222.0.33 () {60 vars in 1396 bytes} [Mon Jun 6 21:09:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:09:55.136639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:09:55.145900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977a0e-3516-4c4f-b451-302e11769c6a service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:09:55.149693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:09:55.150344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:09:55.150624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:09:55.150892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:09:55.152728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:09:55.169548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:09:55.173814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:09:55.185360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1200/2412] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:03.729735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:05.179595 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:13.904057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:13.904702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:13.904988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:13.941633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] MFA Rules not processed for user `8713cb23a93147f8b52f88e240c81d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:10:13.943814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:13.953835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1213/2413] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:10:14.310417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:14.321294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec0dd-d3ea-4c2e-a556-1073cf9c97fc service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:14.325470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:14.326188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:14.326468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:14.326768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:14.329290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:14.350647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:14.352263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7581-359f-4540-bfe7-cdd73ac2c02a service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:14.362888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1201/2414] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:14.754386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:14.756008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:14.856502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5279bb6-59a3-449c-ab0f-17682dc6bd7a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:14.864971 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:14.866076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:14.866518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:14.866983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:14.870032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:14.886220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:14.888506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:14.899326 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1214/2415] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:19.051902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:19.051902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:19.052429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:19.078911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] MFA Rules not processed for user `ab9da673f40b4e3eb541fdc380cfe282`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:10:19.080234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:19.094272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1202/2416] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:10:24.532149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:24.534743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:24.551330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a6ebe-be20-4c01-8285-d18dab579c76 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:24.561605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:24.562335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:24.562622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:24.562928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:24.565179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:24.578847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:24.580662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:24.592495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1215/2417] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:28.056205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:28.073763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56fbb-40ce-4d58-8697-1e67bdc04f60 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:28.082727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:28.083936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:28.084516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:28.085030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:28.088392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:28.111389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:28.114770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:28.132059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1203/2418] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:28.228100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:28.229603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:28.244929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850259ee-e7b4-47ce-9bbe-98d49ed173ba service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:28.252040 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:28.253075 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:28.253310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:28.253585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:28.255711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:28.267895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:28.267895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:28.282784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1216/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:29.526883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:29.541011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9884-890d-422a-b48b-2310d3855cac service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:29.547451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:29.548167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:29.548450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:29.548722 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:29.551189 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:29.563720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:29.565519 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:29.577958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1204/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:29.627420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:29.646545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c86b61-50ef-4ccf-9bd9-a0e3c1451393 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:29.654067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:29.655110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:29.655499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:29.655895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] PATH_INFO: `/v3/users/3f74038b57aa477283f7c8fabebd19be` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:29.657843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f74038b57aa477283f7c8fabebd19be)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:29.660274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:29.734418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f74038b57aa477283f7c8fabebd19be'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:29.742655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f74038b57aa477283f7c8fabebd19be'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:29.761369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f74038b57aa477283f7c8fabebd19be'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:29.762526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f74038b57aa477283f7c8fabebd19be'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:29.773479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f74038b57aa477283f7c8fabebd19be'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:29.787395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1217/2421] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:10:29 2022] DELETE /identity/v3/users/3f74038b57aa477283f7c8fabebd19be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:10:29.988874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:30.003112 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecf9d5-4146-4dec-a763-b56e2a32324d service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:30.073104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:30.074005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:30.074292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:30.074570 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] PATH_INFO: `/v3/projects/a00a423b890b4dc0b4410220da7cdaa8` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:30.075902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00a423b890b4dc0b4410220da7cdaa8)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:30.078231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:30.134544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00a423b890b4dc0b4410220da7cdaa8', 'request_id': 'req-1a9be43e-df77-40b2-897f-a7781f1612cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:30.141310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00a423b890b4dc0b4410220da7cdaa8', 'request_id': 'req-1a9be43e-df77-40b2-897f-a7781f1612cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:30.147610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00a423b890b4dc0b4410220da7cdaa8', 'request_id': 'req-1a9be43e-df77-40b2-897f-a7781f1612cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:30.161812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] The token cache is being invalidate because project a00a423b890b4dc0b4410220da7cdaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:10:30.162153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:30.162750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1a9be43e-df77-40b2-897f-a7781f1612cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:10:30.164375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1205/2422] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:10:29 2022] DELETE /identity/v3/projects/a00a423b890b4dc0b4410220da7cdaa8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:10:33.010626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:33.012518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:33.067930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:33.137788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b29c6-839a-4a77-ad67-941ae65f5b32 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:33.222543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:33.223218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:33.223510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:33.223773 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:33.225862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:33.238486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:33.240223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:33.252967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1218/2423] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:10:40.158470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:43.248344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=49 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:55.021370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:55.022014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:55.022014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:55.042832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:10:55.044123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:55.114372 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1206/2424] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:10:55.170771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:10:55.172336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:10:55.250240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bec04-1730-494f-bbaf-da3cfd06cb04 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:10:55.256673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:10:55.257360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:10:55.257645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:10:55.257934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:10:55.267788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:10:55.269473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf94-a70d-458f-8f23-45d263742217 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:10:55.278830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1219/2425] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:02.586795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:02.589177 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:02.701670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607d74b-0f39-4c67-9949-ab8d709f650a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:02.710798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:02.711862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:02.712375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:02.712854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:02.715751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:02.801649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:02.801649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4fb78-2d6d-462a-961d-ca35bc2766a8 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:02.813907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1207/2426] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:05.275260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=32 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:12.809916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=73 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:15.334229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.335585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.336104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.339080 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1220/2427] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:11:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:11:15.347587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec657a-b21a-45cb-8731-ab3a217c8a44 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.349090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec657a-b21a-45cb-8731-ab3a217c8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.349889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec657a-b21a-45cb-8731-ab3a217c8a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.375174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-37ec657a-b21a-45cb-8731-ab3a217c8a44 None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:15.376657 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-37ec657a-b21a-45cb-8731-ab3a217c8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:15.389418 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1208/2428] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:11:15.406102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:15.409112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:15.530047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d02f8-343b-4942-92eb-8df31d2c7dc8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:15.536689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:15.538207 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.538641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.539077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.555665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:15.557232 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf9a00-a257-4a61-a7bc-7fccafcf4792 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:15.572306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1221/2429] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:15.674071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.674601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.674861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.681341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1209/2430] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:11:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:11:15.688098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c9c3-68cd-4eea-bfa0-9acc88c03a0b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.688396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c9c3-68cd-4eea-bfa0-9acc88c03a0b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.688685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c9c3-68cd-4eea-bfa0-9acc88c03a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.713916 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a837c9c3-68cd-4eea-bfa0-9acc88c03a0b None None] MFA Rules not processed for user `a77e82299a2d4e679032867478dc7247`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:15.715235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a837c9c3-68cd-4eea-bfa0-9acc88c03a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:15.799820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1222/2431] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:15.815819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:15.819398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:15.845437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927bba-5f04-4766-a811-7fc057944dab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:15.850083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:15.850871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.851218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.851565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.861205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:15.862738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad0d0-255e-43e8-a913-c6fa141feb45 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:15.874232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1210/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:11:15.980577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e87-2fd1-461b-9279-70ed524a6253 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.980994 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e87-2fd1-461b-9279-70ed524a6253 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.981443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e87-2fd1-461b-9279-70ed524a6253 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:15.983193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1223/2433] 10.222.0.33 () {54 vars in 921 bytes} [Mon Jun 6 21:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 21:11:15.992810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d0a1-5343-42a9-89ac-1abbb51c143a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:15.993244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d0a1-5343-42a9-89ac-1abbb51c143a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:15.993633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914d0a1-5343-42a9-89ac-1abbb51c143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:16.024752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6914d0a1-5343-42a9-89ac-1abbb51c143a None None] MFA Rules not processed for user `4746a0f4669742ba9e03404e04ae0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:16.027315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6914d0a1-5343-42a9-89ac-1abbb51c143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:16.044630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1211/2434] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Jun 6 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:16.062847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395e87-2fd1-461b-9279-70ed524a6253 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:16.087620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395e87-2fd1-461b-9279-70ed524a6253 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:16.095540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:16.096672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:16.097221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:16.097731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:16.120571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:16.123696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:16.160306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1224/2435] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:18.357407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a196d-cd94-446e-ae04-bcbb9edc53e8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:18.358033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a196d-cd94-446e-ae04-bcbb9edc53e8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:18.358175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a196d-cd94-446e-ae04-bcbb9edc53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:18.380480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c73a196d-cd94-446e-ae04-bcbb9edc53e8 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:18.381761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c73a196d-cd94-446e-ae04-bcbb9edc53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:18.390801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1212/2436] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:18.407838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:18.422823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243220-f663-47cc-9e20-e7f83a68af44 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:18.428487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:18.429354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:18.429777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:18.430079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:18.441682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:18.443589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:18.456076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1225/2437] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:28.374153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=15 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:28.450095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=61 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:38.964990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:38.966707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:38.966707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:39.013736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:39.016002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:39.030976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1213/2438] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:11:39.067289 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:39.092096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574498f-7a84-4d0f-9d0c-c109cde5080b service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:39.101452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:39.102648 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:39.103333 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:39.104490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:39.122951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:39.127249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:39.143469 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1226/2439] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:39.351295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:39.353401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:39.383491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ef2b-a83f-439f-80df-d2b8bd00bfee None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:39.388032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:39.391089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:39.391375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:39.391819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:39.397141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:39.495614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:39.498554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:39.517653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1214/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:40.131022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:40.146456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd60f-6082-4bb3-a380-2458596c966a service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:40.150702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:40.151605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:40.151922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:40.152311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:40.154511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:40.169933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:40.171957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:40.186278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1227/2441] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:45.207908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:45.211327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:45.374631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7702-b33d-419b-b536-e364826cc372 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:45.383649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:45.384720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:45.385192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:45.385666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:45.388938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:45.408130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:45.412209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:45.428628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1215/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:11:45.796696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:45.796696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:45.810665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0f65-d6a3-4daf-8dad-fe082dd4c813 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:45.816852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:45.817985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:45.818273 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:45.818547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] PATH_INFO: `/v3/users/ab9da673f40b4e3eb541fdc380cfe282` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:45.819942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9da673f40b4e3eb541fdc380cfe282)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:45.822060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:45.895478 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9da673f40b4e3eb541fdc380cfe282'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:45.909026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9da673f40b4e3eb541fdc380cfe282'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:45.931746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9da673f40b4e3eb541fdc380cfe282'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:45.933059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9da673f40b4e3eb541fdc380cfe282'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:45.945691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9aca01e8-6e0d-4c42-82a2-e374ea219f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9da673f40b4e3eb541fdc380cfe282'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:45.956735 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1228/2443] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:11:45 2022] DELETE /identity/v3/users/ab9da673f40b4e3eb541fdc380cfe282 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:46.415448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:46.431621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b254e-edff-4227-b729-07a77c286a0b service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:46.536453 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:46.537578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:46.537918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:46.538271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] PATH_INFO: `/v3/projects/f0246519bc2240cf8d1ba54172c0faca` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:46.540263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0246519bc2240cf8d1ba54172c0faca)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:46.542747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:46.585598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:46.629755 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0246519bc2240cf8d1ba54172c0faca', 'request_id': 'req-fc05ea55-774d-4147-b671-3d800449dd4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:46.638788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0246519bc2240cf8d1ba54172c0faca', 'request_id': 'req-fc05ea55-774d-4147-b671-3d800449dd4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:46.648553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0246519bc2240cf8d1ba54172c0faca', 'request_id': 'req-fc05ea55-774d-4147-b671-3d800449dd4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:46.670876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] The token cache is being invalidate because project f0246519bc2240cf8d1ba54172c0faca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:11:46.671176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:46.672179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fc05ea55-774d-4147-b671-3d800449dd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:46.679055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1216/2444] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:11:46 2022] DELETE /identity/v3/projects/f0246519bc2240cf8d1ba54172c0faca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:46.683731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:46.684413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:46.685057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:46.710646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:46.712258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:46.831668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1229/2445] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:46.841503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:46.842012 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:46.842484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:46.904934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:46.908456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:46.927072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1217/2446] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:46.932260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:46.950561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a049c0-9c9b-4956-a51b-c7ac1f1b5257 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:46.983468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:46.985374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:46.985867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:46.986312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:46.987659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:11:46.988144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:46.990062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.060180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1230/2447] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:11:47.062839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.076797 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd2cf-1fa5-4e81-89ac-c2b4694c1a24 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:47.084917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:47.085694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.086033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.086366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.087192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:47.089826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.182431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.184646 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1218/2448] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:11:47 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:11:47.218465 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555e-4057-46a2-9b8d-72d1060f9b28 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:47.297251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:47.369887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:47.372088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.372636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.373114 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.374417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:47.377382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.414522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1231/2449] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:11:47 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:11:47.419837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.439501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfe4ca-636e-48e4-888b-bbe5896a107a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:47.449062 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:47.450351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.451718 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.452400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.454390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:47.457554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.487335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1219/2450] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:11:47.494251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.514846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaf8e6-834c-4b38-8118-4b9920f41bf6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:47.522634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:47.523348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.523635 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.523912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.524702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:47.526387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2c01-88d6-48d1-a94c-b1bee362bd90 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.544290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1232/2451] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:11:47.547389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.561724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac05f7-c651-41fe-bfcc-c24a519ac507 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:47.568309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:47.570265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.570780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.571253 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] PATH_INFO: `/v3/projects/ce7fbb51b32d4342a7b06db4199b5638/users/0ecf39d671ac4f52be5dd80a5ec55615/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.595828 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7fbb51b32d4342a7b06db4199b5638, user_id=0ecf39d671ac4f52be5dd80a5ec55615, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:47.599505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:47.628763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1220/2452] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:11:47 2022] PUT /identity/v3/projects/ce7fbb51b32d4342a7b06db4199b5638/users/0ecf39d671ac4f52be5dd80a5ec55615/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:47.631906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:47.632733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:47.633246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:47.699976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:47.703792 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:47.852370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1233/2453] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:47.868106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:47.875473 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:48.006419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2380a-a56e-4410-8a9f-4a536ad988ff admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:48.013904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:48.015037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:48.015323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:48.016211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:48.030217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:48.031825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:48.056420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1221/2454] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:52.090515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:52.092943 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:52.118276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d932b-fa70-4e06-9124-f1ff07f38b68 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:52.131372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:52.132972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:52.133440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:52.134213 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] PATH_INFO: `/v3/users/67481128d30049d29d5f0e66b1a4c970` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:52.137155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67481128d30049d29d5f0e66b1a4c970)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:52.140845 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:52.224057 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67481128d30049d29d5f0e66b1a4c970'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.238352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67481128d30049d29d5f0e66b1a4c970'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.258471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67481128d30049d29d5f0e66b1a4c970'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.259704 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67481128d30049d29d5f0e66b1a4c970'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.274215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67481128d30049d29d5f0e66b1a4c970'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.285265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1234/2455] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:11:52 2022] DELETE /identity/v3/users/67481128d30049d29d5f0e66b1a4c970 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:52.581904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:52.604788 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9592a6-b74e-49f0-bd59-d2ddb3423e2d service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:52.715981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:52.779246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:52.780093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:52.783089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:52.783089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] PATH_INFO: `/v3/projects/370f0df7dc4745edb578a5f922c0f57f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:52.784044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370f0df7dc4745edb578a5f922c0f57f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:52.790136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:52.923556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370f0df7dc4745edb578a5f922c0f57f', 'request_id': 'req-d926ad00-f975-4579-813b-3b49f3462171'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.945368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370f0df7dc4745edb578a5f922c0f57f', 'request_id': 'req-d926ad00-f975-4579-813b-3b49f3462171'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:52.956734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370f0df7dc4745edb578a5f922c0f57f', 'request_id': 'req-d926ad00-f975-4579-813b-3b49f3462171'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.009688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] The token cache is being invalidate because project 370f0df7dc4745edb578a5f922c0f57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:11:53.009688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.020059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.020059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1222/2456] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:11:52 2022] DELETE /identity/v3/projects/370f0df7dc4745edb578a5f922c0f57f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:53.024986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:53.026154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:53.047149 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487070a-ad4b-4a7f-a5d0-866cab70899b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:53.085183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:53.189993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:53.191783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:53.192268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:53.200986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] PATH_INFO: `/v3/users/f0ef0465c5fc4ac98aa2240223cc00ce` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:53.204418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ef0465c5fc4ac98aa2240223cc00ce)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:53.207715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:53.312433 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ef0465c5fc4ac98aa2240223cc00ce'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.327440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ef0465c5fc4ac98aa2240223cc00ce'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.351795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ef0465c5fc4ac98aa2240223cc00ce'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.353579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ef0465c5fc4ac98aa2240223cc00ce'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.368969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ef0465c5fc4ac98aa2240223cc00ce'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:53.384880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1235/2457] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:11:53 2022] DELETE /identity/v3/users/f0ef0465c5fc4ac98aa2240223cc00ce => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:11:53.841452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:53.843281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:53.866047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926ad00-f975-4579-813b-3b49f3462171 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:53.962820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:53.963643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:53.964379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:53.964379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] PATH_INFO: `/v3/projects/5876c554325d4b499be50df57589c242` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:53.965970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5876c554325d4b499be50df57589c242)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:53.968264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:54.071594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5876c554325d4b499be50df57589c242', 'request_id': 'req-d02094b2-12e7-4d1f-9222-79d216f62b89'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:54.084402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5876c554325d4b499be50df57589c242', 'request_id': 'req-d02094b2-12e7-4d1f-9222-79d216f62b89'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:54.093492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5876c554325d4b499be50df57589c242', 'request_id': 'req-d02094b2-12e7-4d1f-9222-79d216f62b89'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:54.110130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:54.116967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] The token cache is being invalidate because project 5876c554325d4b499be50df57589c242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:11:54.117324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:54.118041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d02094b2-12e7-4d1f-9222-79d216f62b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:11:54.119780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1223/2458] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:11:53 2022] DELETE /identity/v3/projects/5876c554325d4b499be50df57589c242 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:11:54.455338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:54.457223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:54.528774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422ba8-9bdb-458b-9c9f-c7a7ebfeea3c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:54.605234 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:54.606380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:54.606874 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:54.607392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:54.610673 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:54.639863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:54.714131 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:54.716201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:54.731507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1236/2459] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:56.036728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425fa0-044a-4370-84c4-1482034f58e8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:56.037286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425fa0-044a-4370-84c4-1482034f58e8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:56.037286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425fa0-044a-4370-84c4-1482034f58e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:56.072630 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a3425fa0-044a-4370-84c4-1482034f58e8 None None] MFA Rules not processed for user `0ecf39d671ac4f52be5dd80a5ec55615`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:56.073575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a3425fa0-044a-4370-84c4-1482034f58e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:56.167288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1224/2460] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:56.183035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:56.184684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:56.302960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5e58-1256-43cd-94a8-a71aa790464a service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:56.310682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:56.312346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:56.312346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:56.312346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:56.323840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:56.325583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:56.337147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1237/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:11:58.384296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:58.384943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:58.385114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:58.426945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] MFA Rules not processed for user `0ecf39d671ac4f52be5dd80a5ec55615`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:11:58.428975 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:58.438648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1225/2462] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:11:59.040871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:11:59.044586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:59.073848 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb94f8-4a2e-4bb1-9792-2000ebe534d3 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:11:59.088335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:11:59.103930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:11:59.108073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:11:59.108719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:11:59.127119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:11:59.155417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:11:59.157462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:11:59.179500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1238/2463] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:00.006664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:00.024435 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:00.042577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c9c75-b1a7-4bfc-8435-d18ab6709f9f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:00.051051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:00.052986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.052986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.052986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] PATH_INFO: `/v3/users/8713cb23a93147f8b52f88e240c81d6f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.054589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8713cb23a93147f8b52f88e240c81d6f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:00.057023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:00.134040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8713cb23a93147f8b52f88e240c81d6f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.158436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8713cb23a93147f8b52f88e240c81d6f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.177185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8713cb23a93147f8b52f88e240c81d6f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.188851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8713cb23a93147f8b52f88e240c81d6f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.189815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363bc72a-f287-453e-9e5f-c2a80673b027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8713cb23a93147f8b52f88e240c81d6f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.197393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1226/2464] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:00 2022] DELETE /identity/v3/users/8713cb23a93147f8b52f88e240c81d6f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:00.496113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:00.510237 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185b5d-63c2-4cc0-857b-899aa04b8fc3 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:00.606764 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:00.607752 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.608257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.608753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] PATH_INFO: `/v3/projects/5a771f1ab27f40aca2d546901cdcecda` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.610321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a771f1ab27f40aca2d546901cdcecda)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:00.612557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:00.650991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:00.689435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a771f1ab27f40aca2d546901cdcecda', 'request_id': 'req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.698224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a771f1ab27f40aca2d546901cdcecda', 'request_id': 'req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.707853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a771f1ab27f40aca2d546901cdcecda', 'request_id': 'req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.724762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] The token cache is being invalidate because project 5a771f1ab27f40aca2d546901cdcecda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:00.725205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.725869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c97f84b8-1c22-4969-9f86-e0dd2e4312a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:00.727442 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1239/2465] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:00 2022] DELETE /identity/v3/projects/5a771f1ab27f40aca2d546901cdcecda => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:00.732430 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.732717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.732990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.754728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:00.756561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:00.821262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:00.843911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1227/2466] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:00.847942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.848551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.848891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.872126 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:00.873310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:00.883195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1240/2467] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:00.888484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:00.905270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabb94-eda3-47d8-b9ee-0d9e804729f5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:00.910972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:00.911662 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.911976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.912291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.913035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:00.913343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:00.915063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:00.929607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1228/2468] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:00.933876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:00.945950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f55e-ee12-44ed-9dce-e0a9f2820b47 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:00.950908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:00.951929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:00.952250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:00.952524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:00.953226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:00.955180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:00.985579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1241/2469] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:00 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:00.990186 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.000642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76eb5b-3c29-4bda-8df4-727ac0c12d62 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.087878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.088653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.088944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.089216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.090454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.094241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.156451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1229/2470] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:00 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:01.160379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.172981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1e1ea-d39e-4d3e-8847-b0898e7ae9de admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.190299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.191069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.193684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.193684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.196839 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.198501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.227554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1242/2471] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:01.230510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.244632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ea936-13ad-4735-b95c-2562537269c4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.253604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.254321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.254592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.254865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.255602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.258239 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44bc72-0c57-443d-8375-a8771a8cac1a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.278356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1230/2472] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:01.279651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.295073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe963539-4cb4-48c5-be76-a8e5ee5ef6b8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.300032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.300983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.301350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.301532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] PATH_INFO: `/v3/projects/013f0ffd08de41c39c42bf1b1cac02aa/users/edd273c89b16411795d76cc4edbc1641/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.326302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=013f0ffd08de41c39c42bf1b1cac02aa, user_id=edd273c89b16411795d76cc4edbc1641, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.329430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.352930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1243/2473] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:01 2022] PUT /identity/v3/projects/013f0ffd08de41c39c42bf1b1cac02aa/users/edd273c89b16411795d76cc4edbc1641/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:01.363812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.364128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.364851 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.395229 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] MFA Rules not processed for user `edd273c89b16411795d76cc4edbc1641`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:01.396515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:01.478959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1231/2474] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:01.483565 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.581868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416063-89c8-49ca-8e1f-4a4cbc05bb9f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.587450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.588179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.588464 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.588723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.589444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.591557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.626337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1244/2475] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:01 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:01.631634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.645336 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3273-519e-4403-a145-59ba675b47e0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.697270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:01.712894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.713712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.714087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.714422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.715281 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.717557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.744480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1232/2476] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:01 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:01.749743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.769363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f401b-71db-423f-bfb2-f90923d0fc10 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.777486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.778641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.779157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.779655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.781137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.784297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.810148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1245/2477] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:01.811622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.824251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0cb2d-8f2e-41a2-be2e-237cd73ce316 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.830214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.831268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.831574 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.831848 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] PATH_INFO: `/v3/projects/d38bdc4422a64054992441cab4978c1e/users/493244af8243445e92751bbde798f214/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.849526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38bdc4422a64054992441cab4978c1e, user_id=493244af8243445e92751bbde798f214, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.852231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:01.873155 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1233/2478] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:01 2022] PUT /identity/v3/projects/d38bdc4422a64054992441cab4978c1e/users/493244af8243445e92751bbde798f214/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:01.878567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:01.891479 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546a0bf-81dd-4162-b175-913be1b35066 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:01.915603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:01.978810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:01.979520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:01.979798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:01.980098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:01.980873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:01.982539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334d01-9933-4d08-89ca-d8fce80ae2ce admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:02.001187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1246/2479] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:02.004321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:02.016004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb71f-6396-4e86-acbd-464372abbe19 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:02.029007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:02.030125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:02.030273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:02.030523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] PATH_INFO: `/v3/projects/d38bdc4422a64054992441cab4978c1e/users/493244af8243445e92751bbde798f214/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:02.033136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38bdc4422a64054992441cab4978c1e, user_id=493244af8243445e92751bbde798f214, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:02.037032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:02.061356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1234/2480] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:02 2022] PUT /identity/v3/projects/d38bdc4422a64054992441cab4978c1e/users/493244af8243445e92751bbde798f214/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:02.062895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:02.063298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:02.063645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:02.112656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] MFA Rules not processed for user `493244af8243445e92751bbde798f214`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:02.114179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:02.229832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1247/2481] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:02.250839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:02.253342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:02.327157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80d75-96ae-4870-b33b-997112edd591 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:02.332814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:02.333781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:02.334073 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:02.334328 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:02.345110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:02.347480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:02.359094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1235/2482] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:02.419623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:02.422135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:02.435633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010269-ab7e-482b-ae91-5111019b6d3b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:02.440293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:02.441274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:02.441791 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:02.442074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:02.512820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:02.515138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c676-b732-4a74-b913-61199c843465 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:02.529498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1248/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:06.139529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:06.212129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b11cc8-a477-4fb8-97c6-0d5ca4bba345 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:06.216943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:06.217832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:06.218105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:06.218468 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] PATH_INFO: `/v3/users/edd273c89b16411795d76cc4edbc1641` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:06.220459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd273c89b16411795d76cc4edbc1641)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:06.223501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:06.284298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:06.286619 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd273c89b16411795d76cc4edbc1641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:06.302222 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd273c89b16411795d76cc4edbc1641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:06.314629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd273c89b16411795d76cc4edbc1641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:06.328629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd273c89b16411795d76cc4edbc1641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:06.329434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd273c89b16411795d76cc4edbc1641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:06.336577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1236/2484] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:06 2022] DELETE /identity/v3/users/edd273c89b16411795d76cc4edbc1641 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:06.341647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:06.342220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:06.342500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:06.372287 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:06.374500 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:06.438328 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:06.463175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1249/2485] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:06.473766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:06.475322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:06.540681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bdee8-038d-45ff-89e7-b0c74096bccc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:06.544547 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:06.545247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:06.545521 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:06.545777 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:06.557915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:06.559638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:06.572889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1237/2486] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:06.918631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:06.921744 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:06.945855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9963af-e887-45e1-b7ae-a7f1d6f364cc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:06.965270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:06.966616 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:06.967095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:06.967557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] PATH_INFO: `/v3/projects/013f0ffd08de41c39c42bf1b1cac02aa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:06.969094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013f0ffd08de41c39c42bf1b1cac02aa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:06.971404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:07.030545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013f0ffd08de41c39c42bf1b1cac02aa', 'request_id': 'req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.039196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013f0ffd08de41c39c42bf1b1cac02aa', 'request_id': 'req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.047691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013f0ffd08de41c39c42bf1b1cac02aa', 'request_id': 'req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.064734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] The token cache is being invalidate because project 013f0ffd08de41c39c42bf1b1cac02aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:07.065703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.066416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.068081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1250/2487] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:06 2022] DELETE /identity/v3/projects/013f0ffd08de41c39c42bf1b1cac02aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:07.072643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:07.086508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aed0f-f2f1-4719-914a-c449d80c0c1b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:07.157261 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:07.158187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:07.158560 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:07.159070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] PATH_INFO: `/v3/users/493244af8243445e92751bbde798f214` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:07.161105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493244af8243445e92751bbde798f214)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:07.163306 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:07.245032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493244af8243445e92751bbde798f214'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.273165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493244af8243445e92751bbde798f214'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.281742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:07.290251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493244af8243445e92751bbde798f214'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.299458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493244af8243445e92751bbde798f214'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.300263 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1563015a-afdd-49f4-a237-30e308a37693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493244af8243445e92751bbde798f214'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.307164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1238/2488] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:07 2022] DELETE /identity/v3/users/493244af8243445e92751bbde798f214 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:07.622858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:07.624495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:07.639796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cfe8d-ecef-4179-aa65-0d0ec603fcd1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:07.710032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:07.711162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:07.711546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:07.711930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] PATH_INFO: `/v3/projects/d38bdc4422a64054992441cab4978c1e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:07.713708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38bdc4422a64054992441cab4978c1e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:07.716258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:07.767803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38bdc4422a64054992441cab4978c1e', 'request_id': 'req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.773683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38bdc4422a64054992441cab4978c1e', 'request_id': 'req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.780349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38bdc4422a64054992441cab4978c1e', 'request_id': 'req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.785094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:07.797252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] The token cache is being invalidate because project d38bdc4422a64054992441cab4978c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:07.797888 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.799548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cd59f820-e44b-4edd-9ca4-e02a971fb2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:07.802197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1251/2489] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:07 2022] DELETE /identity/v3/projects/d38bdc4422a64054992441cab4978c1e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:07.807286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:07.807697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:07.808160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:07.831218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:07.832541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:07.917399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1239/2490] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:07.927562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346486-caab-456a-9766-01ad39d45537 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:07.927849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346486-caab-456a-9766-01ad39d45537 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:07.928157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346486-caab-456a-9766-01ad39d45537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:07.949356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a4346486-caab-456a-9766-01ad39d45537 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:07.950575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4346486-caab-456a-9766-01ad39d45537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:07.960470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1252/2491] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:07.966644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:07.981739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302c54-1276-46b7-adb7-ebed5e87765d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:07.988914 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:07.989592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:07.989856 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:07.990154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:07.990895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:07.991193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:07.992911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.006837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1240/2492] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:08.011782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346486-caab-456a-9766-01ad39d45537 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.022342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346486-caab-456a-9766-01ad39d45537 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.027766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.028485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.028771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.029045 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.029748 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.031660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.063679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1253/2493] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:08.070064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.080832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf7be-cc08-4f86-aa6b-62df6e6e6137 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.151030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.151717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.152020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.152302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.153015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.155088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.179949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1241/2494] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:08.185675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.202810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f732-f0d1-47b9-adde-4f043194374b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.208544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.209238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.209970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.209970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.210530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.212186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.224521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1254/2495] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:08.229678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.242078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca07d-01c7-4bf1-8f7c-913f77062f21 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.247823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.248544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.248827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.249098 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.249846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.251449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80774bd9-e9f3-4038-b7e0-7c7bd8037f75 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.263583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1242/2496] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:08.268552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.279751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9d472-e973-4d3d-a93b-328d45c55d73 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.286936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.287859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.288260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.288731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] PATH_INFO: `/v3/projects/4cde24dc399d45e4ab39adb0252e8e45/users/b7ad6dd7cdc748a4852d7a0d56a99cab/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.306279 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cde24dc399d45e4ab39adb0252e8e45, user_id=b7ad6dd7cdc748a4852d7a0d56a99cab, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.308894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.325118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1255/2497] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:08 2022] PUT /identity/v3/projects/4cde24dc399d45e4ab39adb0252e8e45/users/b7ad6dd7cdc748a4852d7a0d56a99cab/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:08.338256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.338591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.339839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.379707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] MFA Rules not processed for user `b7ad6dd7cdc748a4852d7a0d56a99cab`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:08.380961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:08.432625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:08.465544 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1243/2498] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:08.471982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.540161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded69ac-3458-499f-9fbd-4f7dd5f95740 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.545160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.545832 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.546143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.546417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.547110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.549174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.581453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1256/2499] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:08.587310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.602565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302df7-d603-4a05-b645-14a837f516ae None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.672765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.673449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.673723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.674023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.674744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.676885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.699681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1244/2500] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/users => generated 307 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:08.703926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.714678 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe2e-b7c3-44b0-aafd-7268cdac51ab admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.719401 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.720097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.720381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.720652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.721386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.723343 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.735930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1257/2501] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:08.740259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.751421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19cec-0e23-41d5-8b99-ba82b06400d4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.756676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.757577 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.757858 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.758128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] PATH_INFO: `/v3/projects/b1445c966357400982e517cfcf0f56f0/users/5837d111c7b84bc7a4836cb103847af4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.780315 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1445c966357400982e517cfcf0f56f0, user_id=5837d111c7b84bc7a4836cb103847af4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.783002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.797262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1245/2502] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:08 2022] PUT /identity/v3/projects/b1445c966357400982e517cfcf0f56f0/users/5837d111c7b84bc7a4836cb103847af4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:08.801599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.812893 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837997-fef6-47ab-981d-e60c40b1cb09 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.886629 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.887361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.887737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.888652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.888917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.890521 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73793f-e368-4a8a-b99b-ea4e62de8300 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.903284 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1258/2503] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:08.908565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:08.924490 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d08f7-e951-41ee-af13-545d5296dffc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:08.929831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:08.930750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.931035 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.931311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] PATH_INFO: `/v3/projects/b1445c966357400982e517cfcf0f56f0/users/5837d111c7b84bc7a4836cb103847af4/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.933354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1445c966357400982e517cfcf0f56f0, user_id=5837d111c7b84bc7a4836cb103847af4, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:08.936664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:08.947943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1246/2504] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:08 2022] PUT /identity/v3/projects/b1445c966357400982e517cfcf0f56f0/users/5837d111c7b84bc7a4836cb103847af4/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:08.959497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:08.959865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:08.960264 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:08.966692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:08.997306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] MFA Rules not processed for user `5837d111c7b84bc7a4836cb103847af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:08.998767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:09.085373 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1259/2505] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:09.093055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:09.094927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:09.157014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9274-bcdf-4236-b8e6-1ac896cb2d4e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:09.161765 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:09.162397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:09.162684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:09.162989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:09.173118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:09.175051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:09.185610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1247/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:09.272348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:09.283208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd9ff-0e4a-4db3-b062-7abd3706509b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:09.289108 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:09.289821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:09.290122 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:09.290380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:09.364981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:09.366661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249582b-7c07-432b-9e68-c72368ba11f7 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:09.381398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1260/2507] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:13.767210 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:13.808929 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:13.837550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fad26c-e5f0-4826-a644-636c91713e1f service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:13.846326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:13.847413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:13.847413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:13.848070 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] PATH_INFO: `/v3/users/b7ad6dd7cdc748a4852d7a0d56a99cab` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:13.849267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ad6dd7cdc748a4852d7a0d56a99cab)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:13.851267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:13.902393 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ad6dd7cdc748a4852d7a0d56a99cab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:13.915205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ad6dd7cdc748a4852d7a0d56a99cab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:13.927001 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ad6dd7cdc748a4852d7a0d56a99cab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:13.934821 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ad6dd7cdc748a4852d7a0d56a99cab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:13.935525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ad6dd7cdc748a4852d7a0d56a99cab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:13.942231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1248/2508] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:13 2022] DELETE /identity/v3/users/b7ad6dd7cdc748a4852d7a0d56a99cab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:13.948310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:13.948951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:13.948951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:13.967599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:13.968837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:14.033385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1261/2509] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:14.044799 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:14.046298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:14.106409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f828-daf2-438d-a50a-309fd611649a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:14.110347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:14.110988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:14.111265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:14.111538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:14.121472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:14.122955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:14.133810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1249/2510] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:14.429618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:14.431682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:14.448055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88741c-b6d0-4486-a4f7-8ad9a6fbecdf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:14.455618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:14.456743 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:14.457086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:14.457526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] PATH_INFO: `/v3/projects/4cde24dc399d45e4ab39adb0252e8e45` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:14.460047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cde24dc399d45e4ab39adb0252e8e45)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:14.461404 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:14.493164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:14.524801 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cde24dc399d45e4ab39adb0252e8e45', 'request_id': 'req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.531462 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cde24dc399d45e4ab39adb0252e8e45', 'request_id': 'req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.538511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cde24dc399d45e4ab39adb0252e8e45', 'request_id': 'req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.555408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] The token cache is being invalidate because project 4cde24dc399d45e4ab39adb0252e8e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:14.555677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.556551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.558399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1262/2511] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:14 2022] DELETE /identity/v3/projects/4cde24dc399d45e4ab39adb0252e8e45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:14.562559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:14.573668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d383-f96e-402c-a017-3fcfe0234465 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:14.634489 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:14.642634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:14.644476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:14.644954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:14.645446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] PATH_INFO: `/v3/users/5837d111c7b84bc7a4836cb103847af4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:14.648741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5837d111c7b84bc7a4836cb103847af4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:14.652535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:14.716340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5837d111c7b84bc7a4836cb103847af4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.729541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5837d111c7b84bc7a4836cb103847af4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.738603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5837d111c7b84bc7a4836cb103847af4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.746618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5837d111c7b84bc7a4836cb103847af4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.747546 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-16d692c7-85e1-4849-8198-57fbcd2d2c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5837d111c7b84bc7a4836cb103847af4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:14.753770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1250/2512] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:14 2022] DELETE /identity/v3/users/5837d111c7b84bc7a4836cb103847af4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:15.081209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.083508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:15.099878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cce2c-49fd-4346-b0fd-32d52f69d0c1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.171475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.173941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.174224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.174497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] PATH_INFO: `/v3/projects/b1445c966357400982e517cfcf0f56f0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.176074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1445c966357400982e517cfcf0f56f0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.178258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.236375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1445c966357400982e517cfcf0f56f0', 'request_id': 'req-4e945e51-823f-49e7-9bb6-5c74a45aa636'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:15.243097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1445c966357400982e517cfcf0f56f0', 'request_id': 'req-4e945e51-823f-49e7-9bb6-5c74a45aa636'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:15.249701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1445c966357400982e517cfcf0f56f0', 'request_id': 'req-4e945e51-823f-49e7-9bb6-5c74a45aa636'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:15.266728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] The token cache is being invalidate because project b1445c966357400982e517cfcf0f56f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:15.266983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:15.267821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4e945e51-823f-49e7-9bb6-5c74a45aa636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:15.269644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1263/2513] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:15 2022] DELETE /identity/v3/projects/b1445c966357400982e517cfcf0f56f0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:15.275912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.276503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.276503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.304517 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:15.305805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:15.378496 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1251/2514] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:15.387630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.387903 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.388236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.410016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:15.412278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:15.422366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1264/2515] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:15.427137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.438310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7b405-8331-4e60-b902-813e5802d1a5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.443457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.444162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.444449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.444725 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.445457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:15.445761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.447380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.461871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1252/2516] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:15.466546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.476610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61b6e-1e02-4837-9191-e86a1bf2b6bb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.482217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.483037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.483362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.483815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.485050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.487007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.530379 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1265/2517] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:15.534918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.547097 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019cb9-6f87-40f4-9b58-eae642424d3b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.614040 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.614843 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.615126 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.615407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.616165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.618122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.632653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:15.646930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1253/2518] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:15.649959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.662248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486f4e1-ab6f-4a8b-ad7a-ce1b36719e40 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.668386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.669188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.669539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.669877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.670691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.672497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.679204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:15.689452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1266/2519] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:15.694477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.707912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92152-51e2-4ebf-bedd-195c12f91d28 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.713561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.714250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.714525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.714791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.715532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.718006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3133-898c-4a16-a7eb-7b7aafe7a4d8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.734676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1254/2520] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:15.739174 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:15.752211 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1a28-77c8-44af-bbf8-b975d7de37db admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:15.757706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:15.759457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.759884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.760201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] PATH_INFO: `/v3/projects/c587759d325645bc823293dbf3db7d6d/users/a1e1242c70264112bb0a4715e126a3a6/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.781930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c587759d325645bc823293dbf3db7d6d, user_id=a1e1242c70264112bb0a4715e126a3a6, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:15.785035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:15.801102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1267/2521] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:15 2022] PUT /identity/v3/projects/c587759d325645bc823293dbf3db7d6d/users/a1e1242c70264112bb0a4715e126a3a6/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:15.815508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:15.815835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:15.816208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:15.852508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] MFA Rules not processed for user `a1e1242c70264112bb0a4715e126a3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:15.853750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:15.970045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1255/2522] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:15.975027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.201390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6f96-3917-45cb-8d4f-65d944c1f169 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.206674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.207380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.208110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.208395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.209098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.211024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.243837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1268/2523] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:15 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:16.245483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.257469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804a555-9b49-436b-9b31-1afaf79990ef None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.334456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.335266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.335564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.335820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.336566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.338506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.374987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1256/2524] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:16 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:16.377179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.394519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecdbf-2ce1-4f3c-bbd9-3a828d9b1a54 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.403906 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.405309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.405831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.406360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.407120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.408825 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.420589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1269/2525] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:16.424976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.436268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdb3-91d3-4d92-a466-ef18a1ae1b12 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.441500 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.444357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.444774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.445110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] PATH_INFO: `/v3/projects/68062241a59b41018ce605cf1d1f5b27/users/bbfca9eee47347b79ae3c896feda46eb/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.464396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68062241a59b41018ce605cf1d1f5b27, user_id=bbfca9eee47347b79ae3c896feda46eb, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.467074 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.488461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1257/2526] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:16 2022] PUT /identity/v3/projects/68062241a59b41018ce605cf1d1f5b27/users/bbfca9eee47347b79ae3c896feda46eb/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:16.492936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.503817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acff96-8934-4a46-9852-3c077c0e8dfa admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.574626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.575311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.575596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.575924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.576960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.578726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c854d-3342-4eb4-8de1-c329e6dbc46c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.595603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1270/2527] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:16.599857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.610808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32e991-d999-49f2-822e-6d5f7af1b602 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.615763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.616717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.617000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.617274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] PATH_INFO: `/v3/projects/68062241a59b41018ce605cf1d1f5b27/users/bbfca9eee47347b79ae3c896feda46eb/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.619272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=68062241a59b41018ce605cf1d1f5b27, user_id=bbfca9eee47347b79ae3c896feda46eb, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.621923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.633413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1258/2528] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:16 2022] PUT /identity/v3/projects/68062241a59b41018ce605cf1d1f5b27/users/bbfca9eee47347b79ae3c896feda46eb/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:16.643634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.643889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.644272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.671962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] MFA Rules not processed for user `bbfca9eee47347b79ae3c896feda46eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:16.673199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:16.714103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:16.756392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1271/2529] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:16.767674 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.769429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:16.807069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:16.836770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2f1b-19ca-4cd4-9f44-db2c82b7bfcd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:16.841118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:16.841883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:16.842169 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:16.842444 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:16.855647 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:16.857165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:16.881808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1259/2530] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:16.978291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:16.991636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a277cb-77f4-4f1c-8251-3966d0a39d59 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:17.002677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:17.003975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:17.004292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:17.004882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:17.111858 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:17.113387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db53e2-6d05-4a11-af4c-c0f21f9f5ca3 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:17.136418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1272/2531] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:17.447187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:17.525507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01390c27-cc11-4acb-9c88-4c1cd0c448a4 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:17.530893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:17.532115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:17.532403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:17.532679 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] PATH_INFO: `/v3/users/a1e1242c70264112bb0a4715e126a3a6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:17.533951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e1242c70264112bb0a4715e126a3a6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:17.536099 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:17.599264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e1242c70264112bb0a4715e126a3a6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:17.617907 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e1242c70264112bb0a4715e126a3a6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:17.629159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e1242c70264112bb0a4715e126a3a6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:17.638347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e1242c70264112bb0a4715e126a3a6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:17.639113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e1242c70264112bb0a4715e126a3a6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:17.646868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1260/2532] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:17 2022] DELETE /identity/v3/users/a1e1242c70264112bb0a4715e126a3a6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:17.652285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:17.652880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:17.652880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:17.675110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:17.676532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:17.748220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1273/2533] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:17.761373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:17.763104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:17.828832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:17.837386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce72edf-8d3f-443f-927f-e26812f0a384 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:17.843200 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:17.843932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:17.844252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:17.844522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:17.856164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:17.857871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:17.870201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1261/2534] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:18.210698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:18.212461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:18.237416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf325f-29fe-457f-a6f2-99a389e2ce64 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:18.246052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:18.247683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:18.248302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:18.248777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] PATH_INFO: `/v3/projects/c587759d325645bc823293dbf3db7d6d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:18.251852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c587759d325645bc823293dbf3db7d6d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:18.256654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:18.325710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c587759d325645bc823293dbf3db7d6d', 'request_id': 'req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.332222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c587759d325645bc823293dbf3db7d6d', 'request_id': 'req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.339607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c587759d325645bc823293dbf3db7d6d', 'request_id': 'req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.342569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:18.359395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] The token cache is being invalidate because project c587759d325645bc823293dbf3db7d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:18.359690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.360365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.363615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1274/2535] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:18 2022] DELETE /identity/v3/projects/c587759d325645bc823293dbf3db7d6d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:18.366787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:18.377389 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5a58-4162-4aa0-b3a0-7df082e71116 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:18.446795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:18.447685 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:18.448469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:18.448469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] PATH_INFO: `/v3/users/bbfca9eee47347b79ae3c896feda46eb` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:18.449720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfca9eee47347b79ae3c896feda46eb)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:18.452308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:18.512095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfca9eee47347b79ae3c896feda46eb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.526868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfca9eee47347b79ae3c896feda46eb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.539491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfca9eee47347b79ae3c896feda46eb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.550086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfca9eee47347b79ae3c896feda46eb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.550985 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a76445e4-0ff0-43c0-acb6-c25aac5a8dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfca9eee47347b79ae3c896feda46eb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:18.559948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1262/2536] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:18 2022] DELETE /identity/v3/users/bbfca9eee47347b79ae3c896feda46eb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:18.924550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:18.926683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:18.953904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f919c0-b256-4c3e-9bd0-1daf8ea6c529 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.055110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.056129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.056480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.056777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] PATH_INFO: `/v3/projects/68062241a59b41018ce605cf1d1f5b27` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.058192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68062241a59b41018ce605cf1d1f5b27)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.060215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.130474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68062241a59b41018ce605cf1d1f5b27', 'request_id': 'req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:19.137407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68062241a59b41018ce605cf1d1f5b27', 'request_id': 'req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:19.148107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68062241a59b41018ce605cf1d1f5b27', 'request_id': 'req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:19.173095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] The token cache is being invalidate because project 68062241a59b41018ce605cf1d1f5b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:19.173543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:19.174226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cec0ab8-ba57-4501-8e16-ce3e87ac9063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:19.175898 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1275/2537] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:18 2022] DELETE /identity/v3/projects/68062241a59b41018ce605cf1d1f5b27 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:19.181801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.182516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.182940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.203203 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:19.204737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:19.270932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1263/2538] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:19.281742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.282016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.282325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.302819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:19.304082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:19.313059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1276/2539] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:19.318007 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.332231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f827f-9d34-4284-9684-30f00388b86e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.338236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.338918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.339192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.339494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.341541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:19.341850 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.343488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.346439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:19.360085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1264/2540] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:19.366650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.377119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8fc7e-1d1d-430a-ba2d-9595c7912828 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.382475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.383127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.383417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.383783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.384552 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.386457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.415194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1277/2541] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:19 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:19.419857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.432182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e0c4-555a-431b-b120-ebb5796b5383 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.506743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.507617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.507749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.508038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.508747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.510766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.534187 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1265/2542] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:19 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:19.538811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.552386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e1d-5461-45a3-ab67-1a6797a437d8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.557661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.558347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.558668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.558952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.559914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.562276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.575387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1278/2543] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:19.580061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.593003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd89e-a4d2-4035-bb7d-d5477f556a34 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.599825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.600561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.600818 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.601092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.601808 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.603414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e821c-e16f-44ce-bb10-7dd4efa8fb0d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.615025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1266/2544] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:19.619593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.630215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee5dc-d93b-4cee-a34d-b8dd2ffcb637 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.635384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.636214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.636497 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.636768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] PATH_INFO: `/v3/projects/03b60a7beda8407782a7a7eef4861f1a/users/153166d340924aedb31c82bcfa82042e/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.653405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b60a7beda8407782a7a7eef4861f1a, user_id=153166d340924aedb31c82bcfa82042e, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.656097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.671829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1279/2545] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:19 2022] PUT /identity/v3/projects/03b60a7beda8407782a7a7eef4861f1a/users/153166d340924aedb31c82bcfa82042e/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:19.677918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353739d-b937-4375-b649-d30e56baf970 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.678277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353739d-b937-4375-b649-d30e56baf970 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.678556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353739d-b937-4375-b649-d30e56baf970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.697710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0353739d-b937-4375-b649-d30e56baf970 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:19.698922 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0353739d-b937-4375-b649-d30e56baf970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:19.771592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1267/2546] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:19.785376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:19.787931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:19.811463 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:19.852014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd542-8e7d-4f9f-9cd5-9ded9195c02e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:19.855786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:19.856472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:19.856749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:19.857018 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:19.867849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:19.869354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:19.880087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1280/2547] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:20.674636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:20.675273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:20.675273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:20.714460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] MFA Rules not processed for user `153166d340924aedb31c82bcfa82042e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:20.715981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:20.800708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1268/2548] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:20.806499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:20.816715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ba36a-111c-4d8d-bebb-f6954fe7daa4 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:20.822064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:20.823055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:20.823327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:20.823591 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:20.824330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:20.826228 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:20.861598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1281/2549] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:20 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:20.863024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:20.870518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:20.874918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98e07c-11e6-4ee9-9c40-21fc8c3fb1bf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:20.945085 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:20.945670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:20.945952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:20.946225 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:20.946924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:20.948903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:20.971499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1269/2550] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:20 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:20.976607 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:20.988554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178295-d459-4dbb-8ba0-ef2d510304ee admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:20.994348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:20.995031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:20.995308 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:20.995579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:20.996416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:20.998015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:21.013691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1282/2551] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:21.018395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:21.029325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3103a6b-5356-4254-ab98-02eb58a287d4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:21.034553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:21.035504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:21.035866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:21.036384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] PATH_INFO: `/v3/projects/9617aef75f74449e8264210c78918aa4/users/bf9d26b152bf4fe6970cb34087a3583d/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:21.053895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9617aef75f74449e8264210c78918aa4, user_id=bf9d26b152bf4fe6970cb34087a3583d, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:21.057086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:21.074704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1270/2552] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:21 2022] PUT /identity/v3/projects/9617aef75f74449e8264210c78918aa4/users/bf9d26b152bf4fe6970cb34087a3583d/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:21.080686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:21.101347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c671f59-b06e-43e8-ac29-fdd61cdd84bf admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:21.164981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:21.165669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:21.165978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:21.166219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:21.166953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:21.168715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:21.180192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1283/2553] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:21.185390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:21.199295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44eb0-abc7-4e8b-98a0-9b4af0cdd6b1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:21.206972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:21.208984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:21.209293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:21.209697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] PATH_INFO: `/v3/projects/9617aef75f74449e8264210c78918aa4/users/bf9d26b152bf4fe6970cb34087a3583d/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:21.213197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9617aef75f74449e8264210c78918aa4, user_id=bf9d26b152bf4fe6970cb34087a3583d, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:21.217862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fd0d8-ac27-49a7-9bd0-9034db8d6f36 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:21.231697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1271/2554] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:21 2022] PUT /identity/v3/projects/9617aef75f74449e8264210c78918aa4/users/bf9d26b152bf4fe6970cb34087a3583d/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:21.335841 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:21.337697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:21.402589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4deae-d6ed-4559-a634-d2d4638d1ccd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:21.447631 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:21.458555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:21.459445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:21.459857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:21.460329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:21.462324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:21.537740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:21.539426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:21.550302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1284/2555] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:21.948874 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:21.949466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:21.949562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:21.981979 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] MFA Rules not processed for user `bf9d26b152bf4fe6970cb34087a3583d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:21.983379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:22.070135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1272/2556] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:22.082159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:22.084430 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:22.159605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c7da-0ed7-4907-9b69-11ec02977523 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:22.163555 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:22.164256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:22.164539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:22.164815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:22.226728 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:22.228276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:22.237923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1285/2557] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:23.730313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:23.732739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:23.748693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a56de-94c7-4127-8639-9e7c0dfe5379 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:23.752943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:23.753950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:23.754486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:23.755030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:23.768969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:23.770920 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:23.783380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1273/2558] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:12:25.114662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:25.116336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:25.152417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dcf2d-1026-4755-85f4-c2fc642db21f service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:25.156896 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:25.157960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.158428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.159079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] PATH_INFO: `/v3/users/602aaa469bed4617b1a0385087066c93` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.160451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=602aaa469bed4617b1a0385087066c93)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:25.163408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:25.219569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:25.227296 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602aaa469bed4617b1a0385087066c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.235516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602aaa469bed4617b1a0385087066c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.252368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602aaa469bed4617b1a0385087066c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.253785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602aaa469bed4617b1a0385087066c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.262937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-93bf8542-800d-4135-a611-9c7a6c76f7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602aaa469bed4617b1a0385087066c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.269138 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1286/2559] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:25 2022] DELETE /identity/v3/users/602aaa469bed4617b1a0385087066c93 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:25.484447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:25.497621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16f2f1-1c45-4970-9a27-9473aa31776e service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:25.529247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:25.565060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:25.565941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.566219 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.566499 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] PATH_INFO: `/v3/projects/576ccf22c37f44fcbe449838cb5673f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.567748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576ccf22c37f44fcbe449838cb5673f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:25.569766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:25.620525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576ccf22c37f44fcbe449838cb5673f6', 'request_id': 'req-79d6f552-5fc5-47ba-9c42-21f339c4d318'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.627101 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576ccf22c37f44fcbe449838cb5673f6', 'request_id': 'req-79d6f552-5fc5-47ba-9c42-21f339c4d318'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.633331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576ccf22c37f44fcbe449838cb5673f6', 'request_id': 'req-79d6f552-5fc5-47ba-9c42-21f339c4d318'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.653176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] The token cache is being invalidate because project 576ccf22c37f44fcbe449838cb5673f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:25.653408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.654190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-79d6f552-5fc5-47ba-9c42-21f339c4d318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:25.656689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1274/2560] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:25 2022] DELETE /identity/v3/projects/576ccf22c37f44fcbe449838cb5673f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:25.662827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.663170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.663476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.684293 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:25.685584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:25.753651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1287/2561] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:25.764565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.764884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.765308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.787023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:25.788371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:25.797701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1275/2562] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:25.804250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:25.814918 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefcea9-fb12-49f8-96f9-4fe179f3f0e9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:25.820457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:25.821118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.821387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.821672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.822399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:25.822705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:25.824348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:25.838164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1288/2563] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:25.845082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:25.859294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c28579-6dae-4ab5-b5ec-8556ad6f3bc8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:25.866791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:25.867457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.867761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.868019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.868846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:25.870637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:25.903311 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1276/2564] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:25 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:25.908783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:25.919807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db545aa-8a05-4c2c-9a27-6c1fe1d1766a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:25.980032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:25.980724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:25.981003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:25.981274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:25.981958 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:25.983859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.009140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1289/2565] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:25 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:26.013284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.024173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6c31-5452-4e1e-865c-c1f810217c9d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.029143 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.029804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.030083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.030355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.031081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.032730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.046330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1277/2566] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:26.050181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.061372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c39-09d5-4fb9-a384-ce5fb3d69356 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.066857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.067654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.067932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.068390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.069119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.070717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59ee8-d03c-4dc3-834c-95c55a5488c6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.081283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1290/2567] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:26.086842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.101776 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6d83-2bd1-42c1-9e5d-04d6a6fa079e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.107692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.108640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.108915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.109185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] PATH_INFO: `/v3/projects/99febd4244314c12878fc88908a89967/users/2f2f2cd3d2b44b2db2de6592127d6e21/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.124959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99febd4244314c12878fc88908a89967, user_id=2f2f2cd3d2b44b2db2de6592127d6e21, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.127591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.148114 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1278/2568] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:26 2022] PUT /identity/v3/projects/99febd4244314c12878fc88908a89967/users/2f2f2cd3d2b44b2db2de6592127d6e21/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:26.159119 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.159641 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.159736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.190715 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] MFA Rules not processed for user `2f2f2cd3d2b44b2db2de6592127d6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:26.192705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:26.206592 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:26.266064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1291/2569] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:26.271140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.333450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:26.338819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333356f-698e-4c0f-8d2e-4df5c3e3d1bc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.345016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.345683 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.345964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.346243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.346955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.349635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.384705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1279/2570] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:26 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:26.389133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.401393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d5de-5e5c-4f51-be1e-2e6bf50cff74 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.481231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.482026 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.482370 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.482742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.483506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.485540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.516838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1292/2571] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:26 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:26.520715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.532246 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f876-1147-4d09-8094-401d5da2a160 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.539116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.539886 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.540364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.540579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.541585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.543409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.560370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1280/2572] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:26.566101 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.578006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded3831-a675-4e38-b305-e5a58c539a60 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.585617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.586525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.586804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.587127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] PATH_INFO: `/v3/projects/acaab27983cb40259684c2add39f4088/users/e92eaa7e8eae468e98188980665eb3f3/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.607809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaab27983cb40259684c2add39f4088, user_id=e92eaa7e8eae468e98188980665eb3f3, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.611189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.633408 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1293/2573] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:26 2022] PUT /identity/v3/projects/acaab27983cb40259684c2add39f4088/users/e92eaa7e8eae468e98188980665eb3f3/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:26.634309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.649130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87682-3c38-425e-82c3-886bec17da00 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.726800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.727937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.728354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.730094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.730094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.731351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30e4d-7470-40de-bfbe-79c3e8b4a9b3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.744507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1281/2574] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:26.748785 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.766125 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75144-cc16-4e1c-a40f-2505d602c953 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:26.772589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:26.773422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.773691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.774003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] PATH_INFO: `/v3/projects/acaab27983cb40259684c2add39f4088/users/e92eaa7e8eae468e98188980665eb3f3/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.776227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaab27983cb40259684c2add39f4088, user_id=e92eaa7e8eae468e98188980665eb3f3, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:26.778942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:26.791338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1294/2575] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:26 2022] PUT /identity/v3/projects/acaab27983cb40259684c2add39f4088/users/e92eaa7e8eae468e98188980665eb3f3/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:12:26.803815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:26.804147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:26.804463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:26.839803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] MFA Rules not processed for user `e92eaa7e8eae468e98188980665eb3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:26.841076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:26.927928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1282/2576] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:26.939460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:26.944254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:27.056534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092081-0425-4f40-a694-813c381f2291 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:27.060445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:27.061111 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:27.061398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:27.061710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:27.073396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:27.075163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bb560-11dd-4a5e-afd9-c6becab755d1 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:27.086962 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1295/2577] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:27.234297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:27.288415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:27.301550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698931-4d78-4a8b-9a65-6ac4fc422bd0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:27.306977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:27.307879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:27.308188 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:27.308459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] PATH_INFO: `/v3/users/2f2f2cd3d2b44b2db2de6592127d6e21` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:27.309744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2f2cd3d2b44b2db2de6592127d6e21)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:27.311690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:27.365933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2f2cd3d2b44b2db2de6592127d6e21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:27.378937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2f2cd3d2b44b2db2de6592127d6e21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:27.389593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2f2cd3d2b44b2db2de6592127d6e21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:27.398923 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2f2cd3d2b44b2db2de6592127d6e21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:27.399784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2f2cd3d2b44b2db2de6592127d6e21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:27.406999 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1283/2578] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:27 2022] DELETE /identity/v3/users/2f2f2cd3d2b44b2db2de6592127d6e21 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:27.412233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:27.412769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:27.412769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:27.431740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:27.432976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:27.437361 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:27.502072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1296/2579] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:27.514424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:27.516052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:27.580659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d362ea8-a778-4026-b777-99227eb69f3b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:27.586004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:27.586716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:27.587021 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:27.587291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:27.600939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:27.602409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:27.613017 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1284/2580] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:27.932762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:27.934608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:27.948535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaaa0d-a88f-47b3-a85a-605762b76239 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:27.953719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:27.955004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:27.955314 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:27.955603 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] PATH_INFO: `/v3/projects/99febd4244314c12878fc88908a89967` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:27.956996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99febd4244314c12878fc88908a89967)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:27.959201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:28.028713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99febd4244314c12878fc88908a89967', 'request_id': 'req-a8f0295c-db96-4249-83ad-115a5ea4d43c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.034431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99febd4244314c12878fc88908a89967', 'request_id': 'req-a8f0295c-db96-4249-83ad-115a5ea4d43c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.041562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99febd4244314c12878fc88908a89967', 'request_id': 'req-a8f0295c-db96-4249-83ad-115a5ea4d43c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.059327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] The token cache is being invalidate because project 99febd4244314c12878fc88908a89967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:28.059645 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.060309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.062233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1297/2581] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:27 2022] DELETE /identity/v3/projects/99febd4244314c12878fc88908a89967 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:28.070954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:28.084423 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26da4f-86ae-4d49-9356-f81eb193bc6c service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:28.169046 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:28.170831 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.171208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.171488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] PATH_INFO: `/v3/users/e92eaa7e8eae468e98188980665eb3f3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.172927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92eaa7e8eae468e98188980665eb3f3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:28.175132 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:28.191956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:28.233271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92eaa7e8eae468e98188980665eb3f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.246767 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92eaa7e8eae468e98188980665eb3f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.256313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92eaa7e8eae468e98188980665eb3f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.263641 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92eaa7e8eae468e98188980665eb3f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.264402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-db9b90a5-6189-4510-a785-7d6cb5c630f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92eaa7e8eae468e98188980665eb3f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.271272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1285/2582] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:28 2022] DELETE /identity/v3/users/e92eaa7e8eae468e98188980665eb3f3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:28.587859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:28.589336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:28.606788 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0295c-db96-4249-83ad-115a5ea4d43c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:28.670470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:28.671305 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.671589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.671862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] PATH_INFO: `/v3/projects/acaab27983cb40259684c2add39f4088` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.673130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaab27983cb40259684c2add39f4088)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:28.675059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:28.721022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:28.733675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaab27983cb40259684c2add39f4088', 'request_id': 'req-7f35bb43-0698-44e1-807e-1d377b1d95d2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.741378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaab27983cb40259684c2add39f4088', 'request_id': 'req-7f35bb43-0698-44e1-807e-1d377b1d95d2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.748412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaab27983cb40259684c2add39f4088', 'request_id': 'req-7f35bb43-0698-44e1-807e-1d377b1d95d2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.762730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] The token cache is being invalidate because project acaab27983cb40259684c2add39f4088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:28.763015 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.763729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f35bb43-0698-44e1-807e-1d377b1d95d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:28.765397 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1298/2583] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:28 2022] DELETE /identity/v3/projects/acaab27983cb40259684c2add39f4088 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:28.770447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.771250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.771250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.789209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:28.790434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:28.854482 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1286/2584] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:28.865485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.865914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.866198 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.885554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:28.886766 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:28.897622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1299/2585] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:28.902627 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:28.913506 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74500-1f15-4467-8897-e2fd92e9b23b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:28.918689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:28.919361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.919640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.919910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.920751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:28.920984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:28.922616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:28.936721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1287/2586] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:28.941205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:28.950969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156dd4-b5bb-4ebc-9977-9807155517fb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:28.956277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:28.956978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:28.957271 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:28.957649 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:28.958362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:28.960402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:28.992747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1300/2587] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:28.996492 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.009043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd69b8-4043-4a61-ae14-afe3c43108b5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.086917 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.087620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.087894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.088217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.088934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.090942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.114836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1288/2588] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:28 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:29.119229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.132948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127467a-b25a-4195-a845-773b636bd4f2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.138663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.139363 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.139646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.140050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.140922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.142733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.155155 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1301/2589] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:29.160339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.172173 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d64dd-acb7-4870-abb4-fd5019e3490f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.177431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.178116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.178404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.178668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.179408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.181079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91707989-1b0c-4277-a859-647ef09d5e8d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.183691 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:29.194398 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1289/2590] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:29.198246 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.209272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a996be-5179-4a84-806f-56c1ffa76c07 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.214118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.215016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.215375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.215563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] PATH_INFO: `/v3/projects/351dfa9f74644036aa3cb776b509aaec/users/5524adc86c1e4558b058e2e1b1c027aa/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.232611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351dfa9f74644036aa3cb776b509aaec, user_id=5524adc86c1e4558b058e2e1b1c027aa, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.236493 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.258217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1302/2591] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:29 2022] PUT /identity/v3/projects/351dfa9f74644036aa3cb776b509aaec/users/5524adc86c1e4558b058e2e1b1c027aa/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:29.278483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.278773 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.279059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.314116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] MFA Rules not processed for user `5524adc86c1e4558b058e2e1b1c027aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:29.316236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:29.406464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1290/2592] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:29.411697 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.495702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be6f4-5ee7-410c-91dd-fbbf4bd5a0e4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.504186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.505376 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.505867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.506435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.507827 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.510518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.541702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1303/2593] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:29 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:29.546092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.566052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5ad2f-c306-4378-81fc-7831066e3052 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.639140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.639852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.640167 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.640451 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.641197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.643149 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.666195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1291/2594] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:29 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:29.670419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.682073 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365adf83-cc68-4a68-9ea8-d11ff9c81df8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.688633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.689486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.689805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.690188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.691020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.692959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.707220 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1304/2595] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:29.712590 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.726361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7ba9-39d9-4f93-a7d0-26f4124f64f4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.731558 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.732258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.732543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.732817 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.733550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.735156 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5868cb-e3e1-43b9-a3a9-2487b9483ab2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.746450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1292/2596] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:29.750688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.761964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d785-8a98-41b1-9914-7d5a6cc42489 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:29.767118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:29.768011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.768311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.768578 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] PATH_INFO: `/v3/projects/9165d0e1b12d4b1e87682b40bf38b744/users/39f8db03f0ad4965bd4c064c2701fac0/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.783652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9165d0e1b12d4b1e87682b40bf38b744, user_id=39f8db03f0ad4965bd4c064c2701fac0, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:29.786661 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:29.807418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1305/2597] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:29 2022] PUT /identity/v3/projects/9165d0e1b12d4b1e87682b40bf38b744/users/39f8db03f0ad4965bd4c064c2701fac0/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:29.823199 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:29.823733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:29.823733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:29.853743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] MFA Rules not processed for user `39f8db03f0ad4965bd4c064c2701fac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:29.854978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:29.928556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:29.943637 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1293/2598] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:29.948238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:29.959187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:30.015037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7de86-d3b0-40bf-a223-645f96ce0114 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.020444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.021527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.021867 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.022179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.023017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.025053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.063602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1306/2599] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:29 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:30.068737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.080640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9536-25b5-4565-a5c8-a9054b0b3052 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.144330 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.145006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.145283 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.145649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.147088 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.149059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.176764 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1294/2600] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:30 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:30.180819 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.191795 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb60af-4a63-4766-84e4-96e2c1e07c87 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.198103 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.198699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.198980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.199247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.199954 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.201926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.213869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1307/2601] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:30.218814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.234154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e31c0-cb13-48eb-9052-1ef643970bd5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.242204 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.243102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.243405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.243678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] PATH_INFO: `/v3/projects/043366c974a045f9836522a52cbf9c51/users/260f029f91d34f06bf3f900d83e9dfc8/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.262347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] RBAC: Authorizing `identity:create_grant(project_id=043366c974a045f9836522a52cbf9c51, user_id=260f029f91d34f06bf3f900d83e9dfc8, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.265089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.281633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1295/2602] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:30 2022] PUT /identity/v3/projects/043366c974a045f9836522a52cbf9c51/users/260f029f91d34f06bf3f900d83e9dfc8/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:30.285995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.296830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4d0f-e5de-4e0b-abff-70a8d11de0b5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.356381 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.357051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.357331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.357602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.358323 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.359923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bb648-3048-4c89-9c60-35f1e6056795 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.370410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1308/2603] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:30.374794 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.387495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0957-65b1-4968-9e4c-3bbdb4b6eded admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.393792 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.394841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.395162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.395458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] PATH_INFO: `/v3/projects/043366c974a045f9836522a52cbf9c51/users/260f029f91d34f06bf3f900d83e9dfc8/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.398466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043366c974a045f9836522a52cbf9c51, user_id=260f029f91d34f06bf3f900d83e9dfc8, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.401448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.415660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1296/2604] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:30 2022] PUT /identity/v3/projects/043366c974a045f9836522a52cbf9c51/users/260f029f91d34f06bf3f900d83e9dfc8/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:30.425983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.426270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.426542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.460382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] MFA Rules not processed for user `260f029f91d34f06bf3f900d83e9dfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:30.461623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:30.535449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1309/2605] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:30.548977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.551045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:30.616247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaf320-37c2-47ef-bfc2-bcf162674913 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.619504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.620192 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.620467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.620735 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.631084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.632569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.643034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1297/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:30.687932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:30.703939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:30.707729 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed8d7-2b06-4e50-92c0-c231e32a6bb4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:30.717990 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:30.718975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:30.720386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:30.720386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:30.794294 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:30.795884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:30.806344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1310/2607] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:32.741446 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:32.743208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:32.797377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:32.818166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33468c92-a4ce-499c-ab65-eb0c6650d934 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:32.823677 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:32.824437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:32.824716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:32.824987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:32.827412 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:32.843016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:32.844700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896052-55ab-443b-b642-f7a7c81078f6 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:32.855842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1298/2608] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:33.780010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:33.849315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa398b-2718-4591-8b22-7a71b7982658 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:33.855048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:33.856156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:33.856598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:33.856872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] PATH_INFO: `/v3/users/5524adc86c1e4558b058e2e1b1c027aa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:33.858259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5524adc86c1e4558b058e2e1b1c027aa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:33.860548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:33.915153 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5524adc86c1e4558b058e2e1b1c027aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:33.922596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5524adc86c1e4558b058e2e1b1c027aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:33.935804 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5524adc86c1e4558b058e2e1b1c027aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:33.936580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5524adc86c1e4558b058e2e1b1c027aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:33.945904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5524adc86c1e4558b058e2e1b1c027aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:33.953970 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1311/2609] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:33 2022] DELETE /identity/v3/users/5524adc86c1e4558b058e2e1b1c027aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:33.958753 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:33.959282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:33.959282 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:33.978994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:33.980274 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:34.047815 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1299/2610] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:34.058734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:34.061176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:34.090440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:34.126593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb08a-437f-4104-9d4c-c4e76b1120c6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:34.131218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de111-31da-4685-a018-4e2218946014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:34.131887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de111-31da-4685-a018-4e2218946014 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:34.132202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de111-31da-4685-a018-4e2218946014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:34.132477 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949de111-31da-4685-a018-4e2218946014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:34.143599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de111-31da-4685-a018-4e2218946014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:34.145267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949de111-31da-4685-a018-4e2218946014 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:34.155928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1312/2611] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:34.453172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:34.454717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:34.468333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bedc5c-e54c-46d5-a102-5e48fe1db43e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:34.474823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:34.475892 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:34.476289 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:34.476634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] PATH_INFO: `/v3/projects/351dfa9f74644036aa3cb776b509aaec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:34.478061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351dfa9f74644036aa3cb776b509aaec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:34.480032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:34.542221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351dfa9f74644036aa3cb776b509aaec', 'request_id': 'req-6ff874f2-9274-456b-845e-01c9def2ab50'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.548919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351dfa9f74644036aa3cb776b509aaec', 'request_id': 'req-6ff874f2-9274-456b-845e-01c9def2ab50'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.555872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351dfa9f74644036aa3cb776b509aaec', 'request_id': 'req-6ff874f2-9274-456b-845e-01c9def2ab50'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.570962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] The token cache is being invalidate because project 351dfa9f74644036aa3cb776b509aaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:34.571252 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.571871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.573684 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1300/2612] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:34 2022] DELETE /identity/v3/projects/351dfa9f74644036aa3cb776b509aaec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:34.579534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de111-31da-4685-a018-4e2218946014 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:34.589674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949de111-31da-4685-a018-4e2218946014 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:34.650558 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:34.651583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:34.651865 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:34.652169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] PATH_INFO: `/v3/users/39f8db03f0ad4965bd4c064c2701fac0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:34.653345 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f8db03f0ad4965bd4c064c2701fac0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:34.655262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:34.707774 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f8db03f0ad4965bd4c064c2701fac0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.715212 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f8db03f0ad4965bd4c064c2701fac0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.726933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f8db03f0ad4965bd4c064c2701fac0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.727652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f8db03f0ad4965bd4c064c2701fac0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.736805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f8db03f0ad4965bd4c064c2701fac0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:34.744366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1313/2613] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:34 2022] DELETE /identity/v3/users/39f8db03f0ad4965bd4c064c2701fac0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:35.044620 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:35.046623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:35.062876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff874f2-9274-456b-845e-01c9def2ab50 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:35.131810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:35.133250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:35.133250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:35.133535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] PATH_INFO: `/v3/projects/9165d0e1b12d4b1e87682b40bf38b744` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:35.134769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9165d0e1b12d4b1e87682b40bf38b744)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:35.137113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:35.146535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:35.194469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9165d0e1b12d4b1e87682b40bf38b744', 'request_id': 'req-f602789a-7606-4a98-8fc1-c3ebab9b4f82'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.201113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9165d0e1b12d4b1e87682b40bf38b744', 'request_id': 'req-f602789a-7606-4a98-8fc1-c3ebab9b4f82'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.209265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9165d0e1b12d4b1e87682b40bf38b744', 'request_id': 'req-f602789a-7606-4a98-8fc1-c3ebab9b4f82'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.224750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] The token cache is being invalidate because project 9165d0e1b12d4b1e87682b40bf38b744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:35.225344 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.226262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.228016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1301/2614] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:35 2022] DELETE /identity/v3/projects/9165d0e1b12d4b1e87682b40bf38b744 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:12:35.232598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:35.234251 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:35.248214 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d135e-52da-4718-957d-dde7129d51e8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:35.292249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:35.310208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:35.311255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:35.311535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:35.311809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] PATH_INFO: `/v3/users/260f029f91d34f06bf3f900d83e9dfc8` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:35.313117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260f029f91d34f06bf3f900d83e9dfc8)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:35.315014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:35.368519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260f029f91d34f06bf3f900d83e9dfc8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.375830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260f029f91d34f06bf3f900d83e9dfc8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.390109 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260f029f91d34f06bf3f900d83e9dfc8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.391130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260f029f91d34f06bf3f900d83e9dfc8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.402340 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4cfe73d2-5131-481b-8ecc-5fd965d123b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260f029f91d34f06bf3f900d83e9dfc8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.409778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1314/2615] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:35 2022] DELETE /identity/v3/users/260f029f91d34f06bf3f900d83e9dfc8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:35.700531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:35.702531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:35.715816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602789a-7606-4a98-8fc1-c3ebab9b4f82 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:35.794928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:35.795816 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:35.796129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:35.796409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] PATH_INFO: `/v3/projects/043366c974a045f9836522a52cbf9c51` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:35.797661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043366c974a045f9836522a52cbf9c51)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:35.799588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:35.858032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043366c974a045f9836522a52cbf9c51', 'request_id': 'req-146670bd-78a1-470a-9f94-b944f3684426'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.865589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043366c974a045f9836522a52cbf9c51', 'request_id': 'req-146670bd-78a1-470a-9f94-b944f3684426'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.872484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043366c974a045f9836522a52cbf9c51', 'request_id': 'req-146670bd-78a1-470a-9f94-b944f3684426'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.887104 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] The token cache is being invalidate because project 043366c974a045f9836522a52cbf9c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:35.887392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.888087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-146670bd-78a1-470a-9f94-b944f3684426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:35.891036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1302/2616] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:35 2022] DELETE /identity/v3/projects/043366c974a045f9836522a52cbf9c51 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:35.896882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:35.897383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:35.897873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:35.922409 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:35.923655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:35.994932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1315/2617] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:36.004618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.005001 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.005240 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.024995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:36.026260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:36.034981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1303/2618] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:36.039703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.055163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50934af7-c9af-4f5a-80d3-1094abcd22ea None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.060930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.061608 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.061902 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.062202 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.062953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:36.063192 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.064834 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.078322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1316/2619] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:12:36.083832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.093863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38383279-41ed-46c2-b205-7d63dd7e3554 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.098902 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.099669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.099845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.100152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.101052 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.102976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.119120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:36.135245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1304/2620] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:36.140030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.151557 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b45f3-fd8e-421c-aa26-32264c3a658c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.204362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:36.216205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.217064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.217329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.217610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.218610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.221079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.243599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1317/2621] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:36 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:36.247970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.259484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7f5a7-224a-402d-bd7b-eb833bd94502 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.264419 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.265110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.265395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.265673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.266597 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.268545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.282915 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1305/2622] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:12:36.284360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.294978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a7f54-3284-44f4-8158-8189cebd5a03 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.299736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.300526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.300747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.301003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.301935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.303683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a7b2-748f-46e1-b2db-0dea600e344a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.317935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1318/2623] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:36.319152 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.330159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905917-515e-4859-ba1d-9bd03d178599 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.335321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.336416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.336555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.336842 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] PATH_INFO: `/v3/projects/02c67e42a3b941bd96455fc9e49952f6/users/6db2a234afc24b36962b688908827d76/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.354511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c67e42a3b941bd96455fc9e49952f6, user_id=6db2a234afc24b36962b688908827d76, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.357361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.382256 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1306/2624] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:36 2022] PUT /identity/v3/projects/02c67e42a3b941bd96455fc9e49952f6/users/6db2a234afc24b36962b688908827d76/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:36.388036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.388359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.388623 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.421201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] MFA Rules not processed for user `6db2a234afc24b36962b688908827d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:36.422776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:36.501268 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1319/2625] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:36.513268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:36.514993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:36.576128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43b954-f74e-4cf3-a397-3549b7518868 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:36.580110 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:36.580761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:36.581038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:36.581305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:36.590362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:36.591904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:36.601728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1307/2626] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:37.338831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:37.340423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:37.425803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e45054-32d3-4f0c-a29e-79bda68edc19 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:37.431277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:37.432703 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:37.432987 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:37.433519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] PATH_INFO: `/v3/users/153166d340924aedb31c82bcfa82042e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:37.435229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153166d340924aedb31c82bcfa82042e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:37.438423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:37.501118 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153166d340924aedb31c82bcfa82042e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.509407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153166d340924aedb31c82bcfa82042e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.515223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:37.527961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153166d340924aedb31c82bcfa82042e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.528775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153166d340924aedb31c82bcfa82042e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.537598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153166d340924aedb31c82bcfa82042e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.543796 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1320/2627] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:37 2022] DELETE /identity/v3/users/153166d340924aedb31c82bcfa82042e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:37.735728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:37.761264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30767e50-d974-4875-8177-e76c7675fd45 service glance] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:37.834329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:37.835232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:37.835509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:37.835780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] PATH_INFO: `/v3/projects/03b60a7beda8407782a7a7eef4861f1a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:37.837127 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b60a7beda8407782a7a7eef4861f1a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:37.839658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:37.902763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b60a7beda8407782a7a7eef4861f1a', 'request_id': 'req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.913254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b60a7beda8407782a7a7eef4861f1a', 'request_id': 'req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.923562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b60a7beda8407782a7a7eef4861f1a', 'request_id': 'req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.927147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:37.941723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] The token cache is being invalidate because project 03b60a7beda8407782a7a7eef4861f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:37.942000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.943317 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:37.945402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1308/2628] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:37 2022] DELETE /identity/v3/projects/03b60a7beda8407782a7a7eef4861f1a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:37.949378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:37.950864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:37.966195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a611be-7a99-4790-8d0c-33cd48e72576 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.032236 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.033276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.033646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.034091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] PATH_INFO: `/v3/users/bf9d26b152bf4fe6970cb34087a3583d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.040288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9d26b152bf4fe6970cb34087a3583d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.040288 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.110900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9d26b152bf4fe6970cb34087a3583d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.120023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9d26b152bf4fe6970cb34087a3583d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.134941 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9d26b152bf4fe6970cb34087a3583d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.135833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9d26b152bf4fe6970cb34087a3583d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.144895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d40a54c6-d19a-4513-a11e-b563578e778c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9d26b152bf4fe6970cb34087a3583d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.155102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1321/2629] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:37 2022] DELETE /identity/v3/users/bf9d26b152bf4fe6970cb34087a3583d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:38.364460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.366284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:38.386940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4e83f-7dbf-41f2-802e-e42c7376bf7b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.464693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.465934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.466262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.466542 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] PATH_INFO: `/v3/projects/9617aef75f74449e8264210c78918aa4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.467869 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9617aef75f74449e8264210c78918aa4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.469888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.527785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9617aef75f74449e8264210c78918aa4', 'request_id': 'req-dc3d30f5-4412-4b53-83a1-03d38af0b04e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.534218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9617aef75f74449e8264210c78918aa4', 'request_id': 'req-dc3d30f5-4412-4b53-83a1-03d38af0b04e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.541122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9617aef75f74449e8264210c78918aa4', 'request_id': 'req-dc3d30f5-4412-4b53-83a1-03d38af0b04e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.558756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] The token cache is being invalidate because project 9617aef75f74449e8264210c78918aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:38.559043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.559825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc3d30f5-4412-4b53-83a1-03d38af0b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:38.561752 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1309/2630] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:38 2022] DELETE /identity/v3/projects/9617aef75f74449e8264210c78918aa4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:38.567731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.568399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.568399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.594422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:38.595650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:38.653956 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:38.666889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1322/2631] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:38.674672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.674962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.675241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.694663 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:38.695906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:38.705726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1310/2632] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:38.710459 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.721297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a99539-978c-4bfe-963a-0bb2205078f9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.726482 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.727151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.727428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.727699 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.728468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:38.728769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.730378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.742679 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1323/2633] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:12:38.747484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.756814 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323f34-7730-4760-b7a4-d2ccd7d53507 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.762709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.763360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.763636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.763911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.764626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.766557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.802050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1311/2634] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:38 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:38.806727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.818055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd93f2-1713-44a9-8f65-a3b61885ce52 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.877506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.878181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.878461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.878750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.879417 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.881696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.905049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1324/2635] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:38 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:38.909422 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.921670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc1c9c-2725-4aa1-aa8f-f5d210ad53b4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.927395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.928095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.928378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.928649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.929378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.930989 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.942108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1312/2636] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:38.949129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:38.962642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7903d-60e2-4897-aeae-678f2d843c22 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:38.968416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:38.969072 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:38.969348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:38.969611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:38.970334 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:38.972021 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05b229-f397-4913-b3df-b5a2e341e853 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:38.984069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1325/2637] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:38.989235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:39.004091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dab83c-953b-42dd-b336-a2e2d37f66b5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:39.010380 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:39.011271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:39.011551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:39.011827 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] PATH_INFO: `/v3/projects/7fcc770331c34affb0d3df7f0ee666aa/users/22f568bc179c486e8ac06e6e0a1a317e/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:39.028033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcc770331c34affb0d3df7f0ee666aa, user_id=22f568bc179c486e8ac06e6e0a1a317e, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:39.030738 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:39.046130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1313/2638] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:38 2022] PUT /identity/v3/projects/7fcc770331c34affb0d3df7f0ee666aa/users/22f568bc179c486e8ac06e6e0a1a317e/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:39.057176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:39.057329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:39.057586 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:39.093171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] MFA Rules not processed for user `22f568bc179c486e8ac06e6e0a1a317e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:39.094426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:39.173656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1326/2639] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:39.181266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:39.183069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:39.210488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:39.257084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc78703-7270-46c2-a783-766f37b502f9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:39.261734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:39.262401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:39.262681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:39.262953 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:39.273998 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:39.275461 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07424c16-2d2d-4d88-b386-29673c36617a service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:39.285721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1314/2640] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:49.166130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:49.281214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=17 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:57.487081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:57.488794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:57.557595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40964-fac4-48c4-82b4-dad858e37e7d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:57.563653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:57.564584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:57.564856 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:57.565188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] PATH_INFO: `/v3/users/6db2a234afc24b36962b688908827d76` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:57.566364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db2a234afc24b36962b688908827d76)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:57.568347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:57.623733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db2a234afc24b36962b688908827d76'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:57.631453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db2a234afc24b36962b688908827d76'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:57.644137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db2a234afc24b36962b688908827d76'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:57.644986 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db2a234afc24b36962b688908827d76'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:57.654140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db2a234afc24b36962b688908827d76'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:57.661968 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1327/2641] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:12:57 2022] DELETE /identity/v3/users/6db2a234afc24b36962b688908827d76 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:57.666733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:57.667284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:57.667284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:57.685940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:57.687142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:57.768322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1315/2642] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:57.782159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:57.783668 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:57.860089 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3423da-2334-403a-ae50-fdb4f67a9371 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:57.864105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:57.864768 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:57.865052 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:57.865331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:57.874991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:57.876513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5fd6-ca59-4de5-8248-2a35f2ae7181 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:57.892602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1328/2643] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:12:58.209294 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.213736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:58.233836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757a2c-8f82-4f1a-8d04-c922ad0ac0bb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.242636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.243522 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.243804 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.244142 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] PATH_INFO: `/v3/projects/02c67e42a3b941bd96455fc9e49952f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.249951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c67e42a3b941bd96455fc9e49952f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.253366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.325731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c67e42a3b941bd96455fc9e49952f6', 'request_id': 'req-868b98ed-960b-4322-a79b-56625913ed58'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:58.332775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c67e42a3b941bd96455fc9e49952f6', 'request_id': 'req-868b98ed-960b-4322-a79b-56625913ed58'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:58.339980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c67e42a3b941bd96455fc9e49952f6', 'request_id': 'req-868b98ed-960b-4322-a79b-56625913ed58'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:58.353384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] The token cache is being invalidate because project 02c67e42a3b941bd96455fc9e49952f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:12:58.353762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:58.354748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-868b98ed-960b-4322-a79b-56625913ed58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:12:58.357458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1316/2644] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:12:58 2022] DELETE /identity/v3/projects/02c67e42a3b941bd96455fc9e49952f6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:58.362484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.363090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.363519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.386749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:58.388324 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:58.409975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:58.462186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1329/2645] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:12:58.471075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.471606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.471957 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.502932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:58.504238 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:58.516770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1317/2646] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:58.521332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.532027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aa908-0f27-4d19-8e00-c90c17a40fff None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.537238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.537917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.538197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.538494 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.539216 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:12:58.539520 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.541955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.555420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1330/2647] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:12:58.559939 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.570042 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f2d4-7a1a-40e6-a987-0b7f5919d121 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.575301 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.576151 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.576399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.576655 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.577705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.579628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.608004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1318/2648] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:12:58 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:12:58.612993 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.629219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858283-89d4-4384-afd9-51bf173feb42 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.691738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.692468 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.692749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.693020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.693731 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.695685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.720454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1331/2649] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:12:58 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:12:58.725255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.741475 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943a3bd-1639-493d-857f-b221a356c222 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.748139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.748840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.749122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.749395 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.750194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.752083 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.765392 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1319/2650] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:58.769385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.781117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99da-1284-4cb9-8949-c39db86514c9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.786012 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.786772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.787060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.787355 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.788209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.789966 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777897-2c1e-452d-896c-3610b4a45679 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.801672 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1332/2651] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:12:58.806068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.816825 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ebbb-719b-4a47-8fc2-82f4e42de135 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:58.821878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:58.822774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.823050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.823323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] PATH_INFO: `/v3/projects/561395f1e06842ff98ee0cbcda212766/users/742676f86a4c481f9a3357b5eadfc527/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.840030 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561395f1e06842ff98ee0cbcda212766, user_id=742676f86a4c481f9a3357b5eadfc527, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:58.842786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:58.858386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1320/2652] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:12:58 2022] PUT /identity/v3/projects/561395f1e06842ff98ee0cbcda212766/users/742676f86a4c481f9a3357b5eadfc527/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:12:58.870316 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:58.870693 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:58.871077 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:58.905190 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] MFA Rules not processed for user `742676f86a4c481f9a3357b5eadfc527`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:12:58.906429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:58.981088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1333/2653] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:12:58.992539 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:12:58.994433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:12:59.017700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:59.073029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbb71-e9af-4c6b-b2e5-cc819fb3e189 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:12:59.077910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:12:59.078716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:12:59.078993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:12:59.079265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:12:59.089562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:12:59.091183 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:12:59.101873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1321/2654] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:00.226365 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:00.227861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:00.253060 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:00.259036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:00.260800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:00.304778 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32384a9-70d1-4edf-b141-f81d96af79f2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:00.310414 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:00.311472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:00.311760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:00.312061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] PATH_INFO: `/v3/users/22f568bc179c486e8ac06e6e0a1a317e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:00.313471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f568bc179c486e8ac06e6e0a1a317e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:00.315656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:00.322681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7ac7-9980-4295-950d-cd71188011fd service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:00.331697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:00.332711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:00.332711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:00.333148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:00.336275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:00.377204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f568bc179c486e8ac06e6e0a1a317e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:00.384992 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f568bc179c486e8ac06e6e0a1a317e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:00.398509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f568bc179c486e8ac06e6e0a1a317e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:00.399580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f568bc179c486e8ac06e6e0a1a317e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:00.410007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97aa0c6e-06a8-4083-8af5-e7d7a91c6e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f568bc179c486e8ac06e6e0a1a317e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:00.410367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:00.411984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:00.416935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1334/2655] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:00 2022] DELETE /identity/v3/users/22f568bc179c486e8ac06e6e0a1a317e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:00.422332 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1322/2656] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:00.424767 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:00.425055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:00.425336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:00.445051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:00.447087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:00.519938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1335/2657] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:13:00.530785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:00.532704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:00.546813 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbbfb-d5cd-40c2-b47e-62552e41e17f service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:00.612781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:00.613709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:00.614141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:00.614562 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:00.626232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:00.628255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eed11-6ae5-44cd-a0b8-7503a35e4786 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:00.644168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1323/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:01.022964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.024799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:01.052688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824712fc-6f95-4e5e-a4bd-13a5fffe2a5a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.067297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.068754 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.069221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.069862 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] PATH_INFO: `/v3/projects/7fcc770331c34affb0d3df7f0ee666aa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.071682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcc770331c34affb0d3df7f0ee666aa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.074217 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.136359 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:01.154675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcc770331c34affb0d3df7f0ee666aa', 'request_id': 'req-49fe600b-4336-41e5-8135-ac52d8ff0b83'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:01.164403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcc770331c34affb0d3df7f0ee666aa', 'request_id': 'req-49fe600b-4336-41e5-8135-ac52d8ff0b83'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:01.174508 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcc770331c34affb0d3df7f0ee666aa', 'request_id': 'req-49fe600b-4336-41e5-8135-ac52d8ff0b83'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:01.196750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] The token cache is being invalidate because project 7fcc770331c34affb0d3df7f0ee666aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:01.196750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:01.197515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-49fe600b-4336-41e5-8135-ac52d8ff0b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:01.199519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1336/2659] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:01 2022] DELETE /identity/v3/projects/7fcc770331c34affb0d3df7f0ee666aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:01.205090 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60504d-78df-4111-8023-79417518d3ef None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.205743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60504d-78df-4111-8023-79417518d3ef None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.205743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60504d-78df-4111-8023-79417518d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.228054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3c60504d-78df-4111-8023-79417518d3ef None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:01.230416 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3c60504d-78df-4111-8023-79417518d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:01.259629 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:01.321358 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1324/2660] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:01.389218 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.389859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.389859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.411889 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:01.413230 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:01.423457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1337/2661] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:01.431128 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60504d-78df-4111-8023-79417518d3ef None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.450309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60504d-78df-4111-8023-79417518d3ef None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.458019 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.458665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.458954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.459228 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.460290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:13:01.460290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.461941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.475349 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1325/2662] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:13:01.480262 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.490983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a83be3-db5c-4565-bf6d-adbd8d6b7e48 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.496222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.496911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.497428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.497702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.498392 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.500378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.528197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1338/2663] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:01 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:01.532516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.542811 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edebd6-efd4-4449-9ff5-7f2c5fadbfd8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.607553 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.608379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.608771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.609125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.610236 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.612535 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.638448 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1326/2664] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:01 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:13:01.643290 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.669181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2632c3-7139-4946-afc9-3a83c8d2edef admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.676676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.677846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.678302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.679053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.680162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.681964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.697095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1339/2665] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:01.701020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.717164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d3764-81c0-4def-8557-b7e191d75f68 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.725233 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.726047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.726331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.726603 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.727341 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.728982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6088e1-22ba-488b-ac71-14da8e53d190 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.742278 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1327/2666] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:01.746206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.758113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f32a-fe1a-45e7-84f6-d4133b3a1557 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:01.764046 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:01.765438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.766575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.767270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] PATH_INFO: `/v3/projects/c68083cf449242dfa26e80bdc07be44a/users/e4c6af9745004674aee4ca6023a5e939/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.802173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68083cf449242dfa26e80bdc07be44a, user_id=e4c6af9745004674aee4ca6023a5e939, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:01.809963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:01.834905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1340/2667] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:01 2022] PUT /identity/v3/projects/c68083cf449242dfa26e80bdc07be44a/users/e4c6af9745004674aee4ca6023a5e939/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:01.844216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:01.844510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:01.844779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:01.878812 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] MFA Rules not processed for user `e4c6af9745004674aee4ca6023a5e939`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:01.879933 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:01.955089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1328/2668] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:01.968044 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:01.970298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:02.037772 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a2bad-f079-4343-b06b-b6331b3e4685 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:02.041511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:02.042252 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:02.042602 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:02.042948 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:02.061223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:02.062733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18d5cf-d664-4254-98f0-cc68c83f1e01 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:02.072718 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1341/2669] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:02.342758 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:02.344458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:02.366652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:02.441002 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec795d-8f25-407a-8e06-d00b455287ee None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:02.461573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:02.462626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:02.462896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:02.463171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] PATH_INFO: `/v3/users/742676f86a4c481f9a3357b5eadfc527` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:02.464635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742676f86a4c481f9a3357b5eadfc527)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:02.467573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:02.532076 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742676f86a4c481f9a3357b5eadfc527'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:02.552284 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742676f86a4c481f9a3357b5eadfc527'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:02.556974 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742676f86a4c481f9a3357b5eadfc527'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:02.566569 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742676f86a4c481f9a3357b5eadfc527'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:02.567355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742676f86a4c481f9a3357b5eadfc527'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:02.573962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1329/2670] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:02 2022] DELETE /identity/v3/users/742676f86a4c481f9a3357b5eadfc527 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:02.579199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:02.579760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:02.580571 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:02.598877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:02.600221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:02.679360 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:02.692598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1342/2671] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:02.699318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:02.700967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:02.767931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9728aa-0601-4157-ba1e-ae5babb78d24 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:02.772235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:02.772900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:02.773182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:02.773456 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:02.783582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:02.785103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740953b6-209a-4b66-a821-de348d0227a6 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:02.797861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1330/2672] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:03.159418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.161083 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:03.187191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1bccf-463d-43a6-9ade-50c5dda19934 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.193270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.194579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.195006 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.195431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] PATH_INFO: `/v3/projects/561395f1e06842ff98ee0cbcda212766` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.196907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561395f1e06842ff98ee0cbcda212766)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.198861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.255086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561395f1e06842ff98ee0cbcda212766', 'request_id': 'req-2ca02bec-6197-48a0-abe1-c5954c625c48'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:03.265386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561395f1e06842ff98ee0cbcda212766', 'request_id': 'req-2ca02bec-6197-48a0-abe1-c5954c625c48'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:03.273106 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561395f1e06842ff98ee0cbcda212766', 'request_id': 'req-2ca02bec-6197-48a0-abe1-c5954c625c48'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:03.287742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] The token cache is being invalidate because project 561395f1e06842ff98ee0cbcda212766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:03.288036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:03.288633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ca02bec-6197-48a0-abe1-c5954c625c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:03.292047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1343/2673] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:03 2022] DELETE /identity/v3/projects/561395f1e06842ff98ee0cbcda212766 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:03.296405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.296698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.296972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.315308 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:03.316556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:03.352644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:03.385667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1331/2674] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:13:03.393859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.394170 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.394476 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.414335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:03.415765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:03.426256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1344/2675] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:03.431374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.444878 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44261e2f-3fdb-4f58-bf96-443cee817859 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.450787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.451478 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.452116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.452439 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.453540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:13:03.454032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.455783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.469092 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1332/2676] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:13:03.475514 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.494851 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f29ec-dc67-4a66-b116-1badf3474fff None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.499582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.500304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.500584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.500854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.501551 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.503449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.541733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1345/2677] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:03 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:03.543557 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.558838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e6f62-c7e6-4f1f-ad57-6d38740370e7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.636175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.637145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.637702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.638218 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.639100 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.642129 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.674556 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1333/2678] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:03 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:13:03.678610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.691733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c11483-b095-40b2-b42c-7049d8eb1e29 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.697223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.697921 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.698201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.698471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.699887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.702298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.714899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1346/2679] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:03.720221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.732015 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e39c-4059-450d-a130-8b145b68f053 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.737118 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.737801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.738120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.738433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.739255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.740972 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd52a5a-0cdc-4964-9114-06cdbb6da1e6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.752290 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1334/2680] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:03.756088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.766667 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21865-5da8-427f-bc9c-6a05a531fe03 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:03.772855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:03.773757 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.774039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.774312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] PATH_INFO: `/v3/projects/87f2196b1a734883b1e015a2591c0ecb/users/442a04455f1d45caa0b61393738d8dbb/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.797866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f2196b1a734883b1e015a2591c0ecb, user_id=442a04455f1d45caa0b61393738d8dbb, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:03.799978 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:03.815550 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1347/2681] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:03 2022] PUT /identity/v3/projects/87f2196b1a734883b1e015a2591c0ecb/users/442a04455f1d45caa0b61393738d8dbb/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:03.829751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:03.830023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:03.830300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:03.858181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] MFA Rules not processed for user `442a04455f1d45caa0b61393738d8dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:03.859421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:03.936230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1335/2682] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:03.947448 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:03.949205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:04.015522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578644-9ee9-420e-b148-6f3b10228e11 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:04.020383 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:04.021047 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:04.021330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:04.021605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:04.030894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:04.032818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:04.059276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1348/2683] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:05.650529 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:05.652660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:05.692839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:05.717737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76a15c-2e41-4a44-aa0e-fb2aabf0003d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:05.721504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:05.722165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:05.722464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:05.722719 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:05.724579 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:05.803399 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:05.804944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:05.816875 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1336/2684] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:12.879341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:12.879341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:12.893681 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe173b-dffc-4a60-be33-7a823384a2c2 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:12.898854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:12.899786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:12.900104 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:12.900375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] PATH_INFO: `/v3/users/36e865c93d844d8aa23661f779cd8e60` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:12.901543 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e865c93d844d8aa23661f779cd8e60)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:12.903486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:12.920950 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:12.960593 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e865c93d844d8aa23661f779cd8e60'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:12.968059 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e865c93d844d8aa23661f779cd8e60'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:12.980278 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e865c93d844d8aa23661f779cd8e60'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:12.981277 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e865c93d844d8aa23661f779cd8e60'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:12.991882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e865c93d844d8aa23661f779cd8e60'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:12.998222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1349/2685] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:12 2022] DELETE /identity/v3/users/36e865c93d844d8aa23661f779cd8e60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:13.188455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:13.204642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47bd56-3418-484a-97a6-d4cbfc6dd8f1 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:13.270326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:13.271197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:13.271472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:13.271741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] PATH_INFO: `/v3/projects/5a68679e2b3544bbb82f944fcae970ef` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:13.272940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a68679e2b3544bbb82f944fcae970ef)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:13.274829 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:13.321343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a68679e2b3544bbb82f944fcae970ef', 'request_id': 'req-210366e6-c40e-45bd-b6c2-6e074b585634'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.327977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a68679e2b3544bbb82f944fcae970ef', 'request_id': 'req-210366e6-c40e-45bd-b6c2-6e074b585634'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.333737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a68679e2b3544bbb82f944fcae970ef', 'request_id': 'req-210366e6-c40e-45bd-b6c2-6e074b585634'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.350362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] The token cache is being invalidate because project 5a68679e2b3544bbb82f944fcae970ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:13.350642 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.351368 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.353045 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1337/2686] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:13 2022] DELETE /identity/v3/projects/5a68679e2b3544bbb82f944fcae970ef => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:13.358587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:13.361135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:13.376686 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d9416-c73c-4ab4-8dbf-a56ece13e9c6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:13.438516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:13.439480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:13.439762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:13.440076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] PATH_INFO: `/v3/users/137d3450d0e94eb4b177ea781b65ded5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:13.441297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137d3450d0e94eb4b177ea781b65ded5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:13.443205 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:13.499816 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137d3450d0e94eb4b177ea781b65ded5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.507093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137d3450d0e94eb4b177ea781b65ded5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.522087 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137d3450d0e94eb4b177ea781b65ded5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.523179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137d3450d0e94eb4b177ea781b65ded5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.533488 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137d3450d0e94eb4b177ea781b65ded5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.541647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1350/2687] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:13 2022] DELETE /identity/v3/users/137d3450d0e94eb4b177ea781b65ded5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:13.798111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:13.799690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:13.815934 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210366e6-c40e-45bd-b6c2-6e074b585634 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:13.825734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:13.879285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:13.880196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:13.880479 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:13.880747 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] PATH_INFO: `/v3/projects/6543932205344b25b661cbe17cee7b6d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:13.881945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6543932205344b25b661cbe17cee7b6d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:13.883841 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:13.932117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6543932205344b25b661cbe17cee7b6d', 'request_id': 'req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.938103 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6543932205344b25b661cbe17cee7b6d', 'request_id': 'req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.944008 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6543932205344b25b661cbe17cee7b6d', 'request_id': 'req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.957800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] The token cache is being invalidate because project 6543932205344b25b661cbe17cee7b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:13.958082 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.958698 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ebb8e85b-59b7-4815-a5e1-ba311b87ac01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:13.960267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1338/2688] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:13 2022] DELETE /identity/v3/projects/6543932205344b25b661cbe17cee7b6d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:23.537032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:23.954445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:26.793522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:26.795610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:26.810215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b439b-ad05-4a02-a522-47f0647b43b2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:26.875031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:26.876020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:26.876315 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:26.876628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] PATH_INFO: `/v3/users/442a04455f1d45caa0b61393738d8dbb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:26.878066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442a04455f1d45caa0b61393738d8dbb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:26.880098 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:26.935163 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442a04455f1d45caa0b61393738d8dbb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:26.942472 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442a04455f1d45caa0b61393738d8dbb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:26.956915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442a04455f1d45caa0b61393738d8dbb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:26.957675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442a04455f1d45caa0b61393738d8dbb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:26.966838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442a04455f1d45caa0b61393738d8dbb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:26.974222 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1351/2689] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:26 2022] DELETE /identity/v3/users/442a04455f1d45caa0b61393738d8dbb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:26.978932 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd917-fd17-4880-93e4-6208f710339c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:26.979464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd917-fd17-4880-93e4-6208f710339c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:26.979464 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd917-fd17-4880-93e4-6208f710339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:26.998916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-262dd917-fd17-4880-93e4-6208f710339c None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:27.000201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-262dd917-fd17-4880-93e4-6208f710339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:27.069863 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1339/2690] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:13:27.080151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.082566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:27.145979 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a141e-c5d8-4690-b1ea-548de2246357 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.150036 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.150736 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.151019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.151285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.161926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.163421 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f047dd-1e54-4c19-950d-7f372d0cb5df service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.174176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1352/2691] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:27.465401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dd917-fd17-4880-93e4-6208f710339c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.467071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-262dd917-fd17-4880-93e4-6208f710339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:27.480618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dd917-fd17-4880-93e4-6208f710339c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.485223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.486107 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.486388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.486724 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] PATH_INFO: `/v3/projects/87f2196b1a734883b1e015a2591c0ecb` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.487952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f2196b1a734883b1e015a2591c0ecb)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.490602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.545125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f2196b1a734883b1e015a2591c0ecb', 'request_id': 'req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:27.552077 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f2196b1a734883b1e015a2591c0ecb', 'request_id': 'req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:27.560554 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f2196b1a734883b1e015a2591c0ecb', 'request_id': 'req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:27.575941 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] The token cache is being invalidate because project 87f2196b1a734883b1e015a2591c0ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:27.576258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:27.577208 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a6e66a08-cfe0-4284-9ed2-90ba6ae97a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:27.578771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1340/2692] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:27 2022] DELETE /identity/v3/projects/87f2196b1a734883b1e015a2591c0ecb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:27.584074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.584298 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.584573 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.605024 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:27.606229 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:27.626033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:27.677020 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1353/2693] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:27.685400 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.685693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.686243 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.707607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:27.709653 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:27.720205 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1341/2694] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:27.725838 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.736121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6908b79-6c28-4090-93b1-cc8149baece1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.741887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.742569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.742859 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.743137 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.743875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:13:27.744219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.745870 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.762123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1354/2695] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:13:27.767720 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.778060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f76a2-4841-427c-a75e-2ffe1f963eb0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.782965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.783701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.783963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.784275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.784988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.787025 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.822408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1342/2696] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:27 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:27.827300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.837733 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3d75-2058-40ea-bc1f-7d8ed68ff396 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.908189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.908771 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.909061 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.909341 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.910054 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.912270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.935443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1355/2697] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:27 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:13:27.939936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.951601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f281d-5512-4025-b04b-013193d73702 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.956761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.957433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.957709 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.958184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.959568 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:27.960911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:27.974741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1343/2698] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:27.981004 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:27.992566 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cb7e-0ad6-46b8-8ca3-1cec3623cf67 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:27.997460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:27.998148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:27.998427 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:27.998714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:27.999570 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:28.001201 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360206c7-c352-45a7-ab92-2edcde305a59 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:28.012975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1356/2699] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:13:28.017313 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:28.028224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e432-1e27-4eaf-bd16-efb541dd9a7e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:28.032977 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:28.033888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:28.034190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:28.034540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] PATH_INFO: `/v3/projects/0eafdd0b0f424a49bb1acec6e0aa7f7e/users/7fb7d984603743029e1b0f24b11f7d36/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:28.054672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eafdd0b0f424a49bb1acec6e0aa7f7e, user_id=7fb7d984603743029e1b0f24b11f7d36, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:28.057666 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:28.075580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1344/2700] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:28 2022] PUT /identity/v3/projects/0eafdd0b0f424a49bb1acec6e0aa7f7e/users/7fb7d984603743029e1b0f24b11f7d36/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:28.086609 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:28.086899 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:28.087177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:28.118385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] MFA Rules not processed for user `7fb7d984603743029e1b0f24b11f7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:28.119938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:28.198509 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1357/2701] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:28.211711 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:28.213617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:28.236640 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:28.277244 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22faa5-9e1a-4db4-9e42-c52db7c3b07b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:28.281029 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:28.281681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:28.281964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:28.282271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:28.295732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:28.297838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d42ff-0a87-40c6-a133-cd12ae05b122 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:28.310209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1345/2702] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:37.580797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:37.601206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:37.648829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134685c2-a793-4aca-a391-55429d9a5391 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:37.653580 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:37.654452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:37.654746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:37.655016 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] PATH_INFO: `/v3/users/7fb7d984603743029e1b0f24b11f7d36` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:37.656276 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb7d984603743029e1b0f24b11f7d36)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:37.658245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:37.715722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb7d984603743029e1b0f24b11f7d36'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:37.723261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb7d984603743029e1b0f24b11f7d36'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:37.736154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb7d984603743029e1b0f24b11f7d36'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:37.736904 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb7d984603743029e1b0f24b11f7d36'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:37.748159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb7d984603743029e1b0f24b11f7d36'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:37.756428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1358/2703] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:37 2022] DELETE /identity/v3/users/7fb7d984603743029e1b0f24b11f7d36 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:37.761075 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:37.761617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:37.761837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:37.780559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:37.781790 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:37.850044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1346/2704] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:37.860831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:37.862362 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:37.936483 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5c40-e4a0-4b59-86f5-45a2b36b0266 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:37.940821 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:37.941952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:37.942240 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:37.942516 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:37.957285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:37.959112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c04af5-b10f-4d97-b1bf-61c30d59c9b3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:37.971227 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1359/2705] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:38.280115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.281694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:38.294798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbf3e4-9e3f-48f0-a1d4-94e12d0aa6fd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.300541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.302304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.302583 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.303027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] PATH_INFO: `/v3/projects/0eafdd0b0f424a49bb1acec6e0aa7f7e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.304593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eafdd0b0f424a49bb1acec6e0aa7f7e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.306705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.377692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eafdd0b0f424a49bb1acec6e0aa7f7e', 'request_id': 'req-7547dad0-1887-4850-a7bd-fc78b8b1565f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:38.386287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eafdd0b0f424a49bb1acec6e0aa7f7e', 'request_id': 'req-7547dad0-1887-4850-a7bd-fc78b8b1565f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:38.395588 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eafdd0b0f424a49bb1acec6e0aa7f7e', 'request_id': 'req-7547dad0-1887-4850-a7bd-fc78b8b1565f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:38.421516 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] The token cache is being invalidate because project 0eafdd0b0f424a49bb1acec6e0aa7f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:38.421862 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:38.422774 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7547dad0-1887-4850-a7bd-fc78b8b1565f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:38.424772 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1347/2706] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:38 2022] DELETE /identity/v3/projects/0eafdd0b0f424a49bb1acec6e0aa7f7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:38.430872 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.431128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.431441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.452467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:38.453723 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:38.490372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:38.527095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1360/2707] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:38.600541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.600954 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.601796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.623181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:38.624459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:38.639434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1348/2708] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:38.644136 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.654589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50f88-6f0f-4ea6-a9f1-992c43e2e223 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.659926 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.660630 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.660909 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.661177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.661905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:13:38.662206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.664342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.676985 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1361/2709] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:13:38.683441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.698576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5ea99-a9f6-4fdb-ad1c-6484d8ab3d8a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.708362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.709417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.709962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.710481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.711184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.713116 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.744326 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1349/2710] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:38.748740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.759180 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b263f-1fe4-4b19-bada-f8fe62cbfe47 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.816708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.817412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.817690 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.817944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.818633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.820750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.844123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1362/2711] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:38 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:38.850357 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.866631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ef28-ff45-477d-b839-cabe4a93e159 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.872094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.872768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.873056 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.873323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.874063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.875694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.887194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1350/2712] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:38.892245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.904481 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8c81e-b17d-430c-b364-6fa697800003 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.911002 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.911937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.912352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.912710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.913637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.916091 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.930694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1363/2713] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:38.935063 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.946137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c3a5-cb7e-4b8c-a166-35b847c09119 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:38.951793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:38.953065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:38.953340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:38.953610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] PATH_INFO: `/v3/projects/d768129e58ea4e4bb4cb2da9a11da521/users/941d5887422e439a8196fc8b38c3f890/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:38.956022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:38.972919 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d768129e58ea4e4bb4cb2da9a11da521, user_id=941d5887422e439a8196fc8b38c3f890, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:38.975768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb08f6-effc-4d06-928c-21757773b254 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:38.996486 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1351/2714] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:38 2022] PUT /identity/v3/projects/d768129e58ea4e4bb4cb2da9a11da521/users/941d5887422e439a8196fc8b38c3f890/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:38.996955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:38.999396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.001351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.001649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.001924 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.013367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13043df-2121-486a-9c56-208dbd2efa01 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:39.019371 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:39.020616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.087405 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1352/2715] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:39.095922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:39.097254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.097545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.097823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] PATH_INFO: `/v3/users/e4c6af9745004674aee4ca6023a5e939` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.098031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:39.099088 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c6af9745004674aee4ca6023a5e939)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:39.099498 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.101188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:39.151253 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c6af9745004674aee4ca6023a5e939'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.152742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:39.161224 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c1e15-b5a5-4ef8-9d7c-6268e0029aa7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:39.161440 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c6af9745004674aee4ca6023a5e939'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.165277 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:39.165936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.166213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.166485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.174717 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c6af9745004674aee4ca6023a5e939'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.175438 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c6af9745004674aee4ca6023a5e939'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.176329 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:39.177800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39335c-e2b3-4228-bb69-1d64d11b36fd service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:39.184568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c6af9745004674aee4ca6023a5e939'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.187982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1353/2716] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:13:39.191169 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1364/2717] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:38 2022] DELETE /identity/v3/users/e4c6af9745004674aee4ca6023a5e939 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:39.195543 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.195826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.196175 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.214312 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:39.215575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.277865 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1354/2718] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:13:39.288107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:39.289881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.356332 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b133e0-ac8b-411e-8237-dbb620e7fc73 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:39.362135 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:39.362823 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.363685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.364093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.377931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:39.380154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6246ec6-3f85-431e-ad20-d4eeee9986a0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:39.393805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1365/2719] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:39.836631 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:39.838139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:39.853403 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c387fac-57a3-472e-937c-854a98c0e612 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:39.860983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:39.861900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.862153 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.862436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] PATH_INFO: `/v3/projects/c68083cf449242dfa26e80bdc07be44a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.864028 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68083cf449242dfa26e80bdc07be44a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:39.865942 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:39.895271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:39.927420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68083cf449242dfa26e80bdc07be44a', 'request_id': 'req-7af09a90-66e7-4035-ad99-a5f9eb7a675d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.933984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68083cf449242dfa26e80bdc07be44a', 'request_id': 'req-7af09a90-66e7-4035-ad99-a5f9eb7a675d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.941635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68083cf449242dfa26e80bdc07be44a', 'request_id': 'req-7af09a90-66e7-4035-ad99-a5f9eb7a675d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.957908 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] The token cache is being invalidate because project c68083cf449242dfa26e80bdc07be44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:39.958705 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.959212 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7af09a90-66e7-4035-ad99-a5f9eb7a675d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:39.962193 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1355/2720] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:39 2022] DELETE /identity/v3/projects/c68083cf449242dfa26e80bdc07be44a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:13:39.968840 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:39.969429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:39.969429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:39.990412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:39.992010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:40.088553 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1366/2721] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:40.098555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.098894 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.099181 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.119947 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:40.121227 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:40.133234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1356/2722] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:40.148139 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.161241 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91a4f-f76f-4862-b406-f89755953cd8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.166964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.167659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.167936 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.168259 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.168996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:13:40.169297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.171049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.184407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1367/2723] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:13:40.189426 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.200050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fde6-0237-4239-884b-2833bfd16d02 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.205520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.206122 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.206386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.206654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.207375 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.209302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.245744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1357/2724] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:40 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:13:40.250102 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.263025 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02c7a8-a9ce-4fc6-a5b9-6d86e8a348d4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.333219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:40.342762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.344093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.344394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.344740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.345467 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.348390 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.379454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1368/2725] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:40 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:40.384138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.396022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059e4c-c4f8-4d72-946d-4b5454c9d100 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.402061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62658505-245b-4814-be92-180608348e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.402810 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62658505-245b-4814-be92-180608348e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.403730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62658505-245b-4814-be92-180608348e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.404585 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62658505-245b-4814-be92-180608348e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.404838 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62658505-245b-4814-be92-180608348e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.406484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62658505-245b-4814-be92-180608348e91 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.419967 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1358/2726] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:40.425193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.439042 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c438-7c0d-4393-9ae9-60b7cc683d16 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.444542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.445380 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.445582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.445969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.446726 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.448798 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3973b-827a-454e-906f-406321b526b0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.475031 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1369/2727] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:40.479209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62658505-245b-4814-be92-180608348e91 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.490921 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62658505-245b-4814-be92-180608348e91 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.495976 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.496955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.497267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.497434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] PATH_INFO: `/v3/projects/0b84d8b897314899bc234c70950c4ef4/users/adf7544064124be48eadf29f367d539a/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.519335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b84d8b897314899bc234c70950c4ef4, user_id=adf7544064124be48eadf29f367d539a, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.524561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.548226 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1359/2728] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:40 2022] PUT /identity/v3/projects/0b84d8b897314899bc234c70950c4ef4/users/adf7544064124be48eadf29f367d539a/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:40.557127 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.557480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.557701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.591547 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] MFA Rules not processed for user `adf7544064124be48eadf29f367d539a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:40.592876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:40.673866 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1370/2729] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:40.690305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:40.692806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:40.772806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5ccc0-1d5c-4500-8a2d-1224fcd7d5a7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:40.777391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:40.777962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:40.778273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:40.778518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:40.789984 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:40.791445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400718-19c3-4267-8dd2-3031e3ade2b5 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:40.802672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1360/2730] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:43.557734 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:43.650391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce60231-633c-4d5b-b0b9-6a1f41755a69 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:43.657270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:43.658250 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:43.658536 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:43.658983 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] PATH_INFO: `/v3/users/adf7544064124be48eadf29f367d539a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:43.660407 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf7544064124be48eadf29f367d539a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:43.662786 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:43.706704 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:43.707254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:43.707254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:43.737847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf7544064124be48eadf29f367d539a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:43.743805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] MFA Rules not processed for user `941d5887422e439a8196fc8b38c3f890`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:43.745111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:43.749123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf7544064124be48eadf29f367d539a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:43.758485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:43.765600 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf7544064124be48eadf29f367d539a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:43.766689 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf7544064124be48eadf29f367d539a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:43.778924 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c3097b83-497e-40ce-8812-08e8fcaf76ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf7544064124be48eadf29f367d539a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:43.790099 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1371/2731] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:13:43 2022] DELETE /identity/v3/users/adf7544064124be48eadf29f367d539a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:43.795676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:43.795676 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:43.795881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:43.801421 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:43.824965 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:43.826782 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:43.840981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1361/2732] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:13:43.845626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:43.847069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:43.863844 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9867f7-ba7d-4d84-83db-f4eb26ec8fdb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:43.908384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1372/2733] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:43.919499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:43.920989 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:43.949981 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:43.950672 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:43.951140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:43.951431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:43.952669 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:43.954760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:43.987105 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1362/2734] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:13:43 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:13:43.991343 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:43.997776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51c591-c3d6-4dc5-a295-a6bc4ad1e096 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.074604 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.075975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.076527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.077358 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.083586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17a623-0a35-4746-a871-913a4f9f9787 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.088143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.089249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.090591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.090739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.090834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.090834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.091234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.093237 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.103617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1373/2735] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 21:13:44.118903 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1363/2736] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:13:43 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:13:44.123158 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:44.133952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946d15-ab1b-4977-9cfd-bd5b5de6dcac service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.140389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.141579 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.141871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.142144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.142878 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.144590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.158614 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1374/2737] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:44.163285 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:44.178872 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1be5c-3cd8-42e3-a672-e8622dc5dddb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.188179 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.189667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.190247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.190845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] PATH_INFO: `/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9/users/f99d9148d50444bcb8483f17a92c09b0/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.214270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a28ed7cfbe54deeb3acadf0b93797b9, user_id=f99d9148d50444bcb8483f17a92c09b0, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.217043 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.236037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1364/2738] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:44 2022] PUT /identity/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9/users/f99d9148d50444bcb8483f17a92c09b0/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:44.239836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:44.251413 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d876b-9de4-431a-93a3-149a4bcd2ff3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.299732 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:44.338321 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.339410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.339698 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.339974 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.340777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.342416 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.353267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1375/2739] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:13:44.357714 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:44.369673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09f78-1453-4556-9d0f-766ed8c424da admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.374969 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.376041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.376331 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.376600 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] PATH_INFO: `/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9/users/f99d9148d50444bcb8483f17a92c09b0/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.378624 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a28ed7cfbe54deeb3acadf0b93797b9, user_id=f99d9148d50444bcb8483f17a92c09b0, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.381297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d518378-611c-4d50-a77b-3a5355852286 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.397565 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1365/2740] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:13:44 2022] PUT /identity/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9/users/f99d9148d50444bcb8483f17a92c09b0/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:44.438399 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:44.440776 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:44.467412 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233c9-270b-4ad4-942e-b131df3e64da admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:44.534617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:44.535515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:44.535808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:44.536171 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] PATH_INFO: `/v3/projects/0b84d8b897314899bc234c70950c4ef4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:44.537541 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b84d8b897314899bc234c70950c4ef4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:44.541885 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:44.595905 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b84d8b897314899bc234c70950c4ef4', 'request_id': 'req-3b30e4c4-d9e3-4132-803f-5ba04488f249'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:44.602312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b84d8b897314899bc234c70950c4ef4', 'request_id': 'req-3b30e4c4-d9e3-4132-803f-5ba04488f249'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:44.608727 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b84d8b897314899bc234c70950c4ef4', 'request_id': 'req-3b30e4c4-d9e3-4132-803f-5ba04488f249'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:44.623930 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] The token cache is being invalidate because project 0b84d8b897314899bc234c70950c4ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:13:44.624257 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:44.624860 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:13:44.626436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1376/2741] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:13:44 2022] DELETE /identity/v3/projects/0b84d8b897314899bc234c70950c4ef4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:13:49.263965 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745266a4-c5ea-4e35-9cec-d37a2debe1d4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:49.264425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745266a4-c5ea-4e35-9cec-d37a2debe1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:49.264524 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745266a4-c5ea-4e35-9cec-d37a2debe1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:49.317178 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-745266a4-c5ea-4e35-9cec-d37a2debe1d4 None None] MFA Rules not processed for user `f99d9148d50444bcb8483f17a92c09b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:49.318531 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-745266a4-c5ea-4e35-9cec-d37a2debe1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:49.323230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:49.433741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1366/2742] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:49.448880 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:49.450601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:49.522460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30e4c4-d9e3-4132-803f-5ba04488f249 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:49.526339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cf17e40aeb64d3598124670b5981935', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:49.527007 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:49.527285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:49.527560 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:49.529396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:49.541160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:49.602783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:49.604304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:49.614159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1377/2743] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:13:49.722532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9936-7f21-44ce-b354-85e21c4b8b15 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:49.722891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9936-7f21-44ce-b354-85e21c4b8b15 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:49.723404 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9936-7f21-44ce-b354-85e21c4b8b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:49.746293 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b72e9936-7f21-44ce-b354-85e21c4b8b15 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:49.747617 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b72e9936-7f21-44ce-b354-85e21c4b8b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:49.816549 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1367/2744] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:49.876931 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:13:49.878529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:49.954783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36acca-553c-4d42-bafa-66bd5cfa8312 service glance] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:13:49.963826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:13:49.964964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:49.965471 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:49.965972 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:49.975973 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:13:49.977382 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4912aa-2c36-463d-80ef-98ffa0edc28c service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:13:49.985422 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1378/2745] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:13:58.567749 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:13:58.568310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:13:58.568409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:13:58.587723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] MFA Rules not processed for user `941d5887422e439a8196fc8b38c3f890`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:13:58.590845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:13:58.599742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1368/2746] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:13:59.982654 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=54 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:00.507244 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:14:00.507545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:14:00.507895 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:14:00.527546 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:14:00.528869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:14:00.536147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1379/2747] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:14:00.548216 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:14:00.563087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88d27-446d-4fa9-8b4b-88763bec908f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:14:00.570918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:14:00.571559 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:14:00.571834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:14:00.572140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:14:00.581591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:14:00.583162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:14:00.592904 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1369/2748] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:14:10.522172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:10.588796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=61 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:26.356032 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:14:26.357619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:14:26.421023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc6c0-4389-408d-95e3-a45a0eba098e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:14:26.424967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:14:26.425627 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:14:26.425914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:14:26.426199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:14:26.436322 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:14:26.437769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:14:26.449873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1380/2749] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:14:29.860783 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:14:29.870335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b97a2-c7cc-4277-9a07-c1513c795965 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:14:29.874493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:14:29.875141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:14:29.875454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:14:29.875731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:14:29.877756 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:14:29.954545 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:14:29.955960 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051546f0-2739-408d-9990-f1e4ab970595 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:14:29.968147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1370/2750] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:14:32.205327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:14:32.207670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:14:32.222292 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880fd7-abd7-488e-8d64-dde1f79813b5 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:14:32.227532 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:14:32.228598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:14:32.229037 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:14:32.229501 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:14:32.233411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:14:32.253142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:14:32.254606 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:14:32.269977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1381/2751] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:14:39.962502 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=34 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:42.261062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=32 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:16.105983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:16.106589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:16.106589 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:16.124220 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] MFA Rules not processed for user `0ecf39d671ac4f52be5dd80a5ec55615`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:15:16.125454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:16.184260 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1371/2752] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:15:16.855662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:16.857636 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:16.930907 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49efd-01ae-4d38-855f-328301b96d31 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:16.935849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:16.936585 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:16.936864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:16.937132 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:16.938967 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:16.951934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:16.953991 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:16.966066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1382/2753] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:15:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:15:18.913761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:18.933893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50ea74-6de7-44cb-8141-9257bebf9708 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:18.938266 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:18.939038 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:18.939384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:18.939726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:18.941769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:18.957234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:18.962592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:18.973823 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1372/2754] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:15:26.959850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=32 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:27.780955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:27.784917 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:27.800740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48545-205a-4d1c-8aa6-df7b08bc708f service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:27.806595 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:27.807313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:27.807615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:27.807894 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:27.809753 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:27.822522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:27.824160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1643-a5fa-47d4-ada0-e33439c55556 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:27.835651 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1383/2755] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:15:28.968638 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=31 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:37.830824 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:53.113230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:53.131401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15ff9-8e91-4c3d-a60b-26d93d11daaa service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:53.138912 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:53.139700 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:53.140084 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:53.140561 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:53.142625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:53.156335 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:53.157973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:53.171440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1373/2756] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:15:54.255199 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:54.255677 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:54.255783 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:54.275353 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:15:54.276587 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:54.284450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1384/2757] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:15:54.326287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:54.338980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5f73-8dda-492a-bb05-b406109ddcca service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:54.344961 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:54.345607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:54.345884 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:54.346157 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:54.355080 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:54.356713 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:54.364994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1374/2758] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:15:57.923751 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:15:57.945410 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f38b8-1c65-4e18-8fc4-0c1b24da2fc4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:15:57.951803 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:15:57.952850 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:15:57.953129 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:15:57.953402 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:15:57.955372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:15:57.968779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:15:57.970429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:15:57.982444 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1385/2759] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:01.197480 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:01.200319 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:01.294652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553014-e33f-4f7d-a012-fcc26383ed33 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:01.299407 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:01.300342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:01.300628 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:01.300898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] PATH_INFO: `/v3/users/941d5887422e439a8196fc8b38c3f890` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:01.302102 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] RBAC: Authorizing `identity:delete_user(user_id=941d5887422e439a8196fc8b38c3f890)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:01.304055 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:01.361268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941d5887422e439a8196fc8b38c3f890'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.373459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941d5887422e439a8196fc8b38c3f890'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.382351 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941d5887422e439a8196fc8b38c3f890'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.389986 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941d5887422e439a8196fc8b38c3f890'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.390670 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941d5887422e439a8196fc8b38c3f890'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.396918 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1375/2760] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:01 2022] DELETE /identity/v3/users/941d5887422e439a8196fc8b38c3f890 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:01.592411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:01.608300 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d401-c3e9-4051-ad19-88c439037565 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:01.666762 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:01.667640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:01.667914 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:01.668208 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] PATH_INFO: `/v3/projects/d768129e58ea4e4bb4cb2da9a11da521` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:01.669664 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d768129e58ea4e4bb4cb2da9a11da521)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:01.671569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:01.721456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd768129e58ea4e4bb4cb2da9a11da521', 'request_id': 'req-b21a18c0-0370-44c8-afab-50ac7c318107'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.727301 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd768129e58ea4e4bb4cb2da9a11da521', 'request_id': 'req-b21a18c0-0370-44c8-afab-50ac7c318107'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.733657 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd768129e58ea4e4bb4cb2da9a11da521', 'request_id': 'req-b21a18c0-0370-44c8-afab-50ac7c318107'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.748526 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] The token cache is being invalidate because project d768129e58ea4e4bb4cb2da9a11da521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:01.748810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.749456 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.751055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1386/2761] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:01 2022] DELETE /identity/v3/projects/d768129e58ea4e4bb4cb2da9a11da521 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:01.755322 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:01.756826 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:01.770995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f8cb-1149-47b0-b12b-c4479d9c914a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:01.829527 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:01.841425 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:01.842327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:01.842612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:01.842889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] PATH_INFO: `/v3/users/f99d9148d50444bcb8483f17a92c09b0` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:01.844145 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99d9148d50444bcb8483f17a92c09b0)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:01.846111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:01.905310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99d9148d50444bcb8483f17a92c09b0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.923140 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99d9148d50444bcb8483f17a92c09b0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.931295 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99d9148d50444bcb8483f17a92c09b0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.938467 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99d9148d50444bcb8483f17a92c09b0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.939120 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99d9148d50444bcb8483f17a92c09b0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:01.945162 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1376/2762] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:01 2022] DELETE /identity/v3/users/f99d9148d50444bcb8483f17a92c09b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:02.138980 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:02.140569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:02.156391 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a18c0-0370-44c8-afab-50ac7c318107 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:02.223330 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:02.224224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:02.224506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:02.224779 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] PATH_INFO: `/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:02.225963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a28ed7cfbe54deeb3acadf0b93797b9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:02.227908 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:02.239429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:02.283187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a28ed7cfbe54deeb3acadf0b93797b9', 'request_id': 'req-ee482dd5-dd8b-4907-a4ae-47dff748a80e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:02.288805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a28ed7cfbe54deeb3acadf0b93797b9', 'request_id': 'req-ee482dd5-dd8b-4907-a4ae-47dff748a80e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:02.295144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a28ed7cfbe54deeb3acadf0b93797b9', 'request_id': 'req-ee482dd5-dd8b-4907-a4ae-47dff748a80e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:02.311942 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] The token cache is being invalidate because project 0a28ed7cfbe54deeb3acadf0b93797b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:02.312267 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:02.312984 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:02.314793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1387/2763] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:02 2022] DELETE /identity/v3/projects/0a28ed7cfbe54deeb3acadf0b93797b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:11.941775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:12.307747 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:35.961846 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:35.963447 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:36.066781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dd37f-23c5-46c4-a115-753b8d3db82a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:36.128231 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:36.129158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.129440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.129712 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] PATH_INFO: `/v3/users/0ecf39d671ac4f52be5dd80a5ec55615` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.131111 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecf39d671ac4f52be5dd80a5ec55615)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:36.132930 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:36.186215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecf39d671ac4f52be5dd80a5ec55615'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.198182 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecf39d671ac4f52be5dd80a5ec55615'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.208648 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecf39d671ac4f52be5dd80a5ec55615'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.216364 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecf39d671ac4f52be5dd80a5ec55615'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.217146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bebfe5d9-ab90-4e4a-af64-5e09065128be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecf39d671ac4f52be5dd80a5ec55615'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.223598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1377/2764] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:35 2022] DELETE /identity/v3/users/0ecf39d671ac4f52be5dd80a5ec55615 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:36.409814 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:36.411352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:36.485235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee482dd5-dd8b-4907-a4ae-47dff748a80e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:36.545335 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:36.546247 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.546527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.546800 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] PATH_INFO: `/v3/projects/ce7fbb51b32d4342a7b06db4199b5638` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.548386 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7fbb51b32d4342a7b06db4199b5638)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:36.550665 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:36.604167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7fbb51b32d4342a7b06db4199b5638', 'request_id': 'req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.610035 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7fbb51b32d4342a7b06db4199b5638', 'request_id': 'req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.616524 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7fbb51b32d4342a7b06db4199b5638', 'request_id': 'req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.631711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] The token cache is being invalidate because project ce7fbb51b32d4342a7b06db4199b5638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:36.632010 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.632646 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c45e1ca6-cf51-46e0-ab85-4581d1db13f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:36.634242 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1388/2765] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:36 2022] DELETE /identity/v3/projects/ce7fbb51b32d4342a7b06db4199b5638 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:36.640582 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.640982 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.641359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.664551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:36.665766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:36.678760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:36.738296 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1378/2766] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:36.746455 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.747030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.747663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.767531 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:36.768802 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:36.777517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1389/2767] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:36.784050 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:36.800805 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38772e-e716-4c0c-8150-a61b3ee1719d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:36.809796 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:36.810454 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.810734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.811004 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.811737 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:16:36.812069 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:36.813696 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:36.825978 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1379/2768] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:16:36.830854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:36.842030 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b80d0-9410-4348-b1b6-2265ef0e7ab2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:36.848419 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:36.849094 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.849378 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.849655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.850346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:36.852286 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:36.881548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1390/2769] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:36.885795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:36.896096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2a8f8-f6f9-4679-8789-ad591d70f13d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:36.960449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:36.961130 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:36.961415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:36.961690 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:36.962402 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:36.964363 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:36.986636 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1380/2770] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:36 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:36.991022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:37.001929 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07905e50-4416-466c-b980-5ffe6f81ba58 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:37.007354 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:37.008029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:37.008342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:37.008638 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:37.009374 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:37.010964 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:37.013548 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:37.023826 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1391/2771] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:16:37.027896 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:37.038501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8afdc-93c8-4e3d-af70-5631dc5c9995 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:37.043687 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:37.044495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:37.044782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:37.045089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:37.045832 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:37.047485 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5f755-d948-4950-ba32-e3d89b7c467c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:37.058235 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1381/2772] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:37.062881 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:37.073231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf1e5-0d58-4f34-b72c-2353218ed9db admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:37.078927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:37.079809 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:37.080116 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:37.080411 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] PATH_INFO: `/v3/projects/a85eea5f8c154566aae74eefecdbba2f/users/38423a68ff8e4d139ea09526e88d99f1/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:37.095669 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85eea5f8c154566aae74eefecdbba2f, user_id=38423a68ff8e4d139ea09526e88d99f1, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:37.098311 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:37.114711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1392/2773] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:37 2022] PUT /identity/v3/projects/a85eea5f8c154566aae74eefecdbba2f/users/38423a68ff8e4d139ea09526e88d99f1/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:16:37.125652 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:37.126032 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:37.126452 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:37.157614 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] MFA Rules not processed for user `38423a68ff8e4d139ea09526e88d99f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:37.159096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:37.247305 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1382/2774] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:37.255811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:37.257883 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:37.361079 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e010e-0f98-4eb0-8605-ae30afdd0dcc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:37.367820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:37.368836 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:37.369188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:37.369530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:37.379182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:37.380811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a0571-b228-451d-a518-fe49fd207eba service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:37.390721 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1393/2775] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:44.753757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:44.766196 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:44.819626 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630da30-adc5-4931-a7d1-0c71df9af601 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:44.824528 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:44.826115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:44.826386 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:44.826996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] PATH_INFO: `/v3/users/38423a68ff8e4d139ea09526e88d99f1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:44.828270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38423a68ff8e4d139ea09526e88d99f1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:44.830750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:44.882835 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38423a68ff8e4d139ea09526e88d99f1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:44.894635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38423a68ff8e4d139ea09526e88d99f1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:44.904592 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38423a68ff8e4d139ea09526e88d99f1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:44.913649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38423a68ff8e4d139ea09526e88d99f1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:44.914373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38423a68ff8e4d139ea09526e88d99f1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:44.921044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1383/2776] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:44 2022] DELETE /identity/v3/users/38423a68ff8e4d139ea09526e88d99f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:44.926831 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:44.927387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:44.927387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:44.959873 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:44.961141 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:45.026231 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1394/2777] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:16:45.036356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.037873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:45.131836 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d8b4-80ae-4afd-8596-64dee871113c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.135970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.136584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.136866 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.137136 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.147661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.149342 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4054e-33c3-4b4c-8d08-20f18eed7073 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.160059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1384/2778] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:45.449076 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.450959 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:45.473110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9661-b08a-4902-b583-4975bedcbbb6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.478159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.479303 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.479527 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.479805 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] PATH_INFO: `/v3/projects/a85eea5f8c154566aae74eefecdbba2f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.481309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85eea5f8c154566aae74eefecdbba2f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.483068 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.523449 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:45.538461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85eea5f8c154566aae74eefecdbba2f', 'request_id': 'req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:45.544003 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85eea5f8c154566aae74eefecdbba2f', 'request_id': 'req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:45.550843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85eea5f8c154566aae74eefecdbba2f', 'request_id': 'req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:45.565525 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] The token cache is being invalidate because project a85eea5f8c154566aae74eefecdbba2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:45.565810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:45.566453 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a4a01b97-aa2c-4c8c-8cbb-e2a630471bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:45.568388 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1395/2779] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:45 2022] DELETE /identity/v3/projects/a85eea5f8c154566aae74eefecdbba2f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:45.573494 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.573769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.574047 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.593526 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:45.594733 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:45.605251 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:45.657995 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1385/2780] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:45.667191 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.667452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.667746 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.687368 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:45.688598 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:45.697069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1396/2781] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:45.701327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.711606 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a226-6ac4-43e3-9f7e-56b42b495418 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.716584 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.717234 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.717511 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.717784 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.718501 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:16:45.718807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.720424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.732367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1386/2782] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:16:45.736977 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.746882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def8e6b-2d15-45bc-9c0a-0e82dca795f8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.752450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.753255 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.753528 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.753799 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.754487 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.756443 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.784705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1397/2783] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:45.789037 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.800302 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89539c7-cad7-4158-b635-88110026e2c7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.870905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.871673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.871956 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.872297 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.873003 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.874950 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.897615 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1387/2784] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:45 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:45.901925 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.913544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909030e-2a0f-47b1-8267-53462f378e4a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.919055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.919724 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.920019 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.920313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.921188 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.922911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.934738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1398/2785] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:45.939280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.955001 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad41f-9b1b-41fc-89b9-253ca03428cf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.960983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.961650 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.961936 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.962197 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:45.962927 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:45.964563 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36940985-e673-45a2-9fb6-5c3d8c510582 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:45.976041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1388/2786] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:45.980350 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:45.990887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea050-777a-42cd-a1e9-6ced5103c13c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:45.996498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:45.997384 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:45.997692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:45.997960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] PATH_INFO: `/v3/projects/d7a1d09103564b64a97b9e1b3f5f151d/users/d9d277f6d8bc4ff58e23165cdbc20a09/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.013940 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a1d09103564b64a97b9e1b3f5f151d, user_id=d9d277f6d8bc4ff58e23165cdbc20a09, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.016643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.035852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1399/2787] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:45 2022] PUT /identity/v3/projects/d7a1d09103564b64a97b9e1b3f5f151d/users/d9d277f6d8bc4ff58e23165cdbc20a09/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:46.048361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.048721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.049201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.079791 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] MFA Rules not processed for user `d9d277f6d8bc4ff58e23165cdbc20a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:46.081159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:46.149483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1389/2788] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:46.154640 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.217863 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc5de8-f6eb-4df9-bfe1-195743689752 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.223470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.224173 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.224452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.224702 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.225387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.227299 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.255554 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1400/2789] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:46 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:46.260185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.276483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8a19f-e2df-41c9-97a6-0ff6363ceca7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.286893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:46.338962 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.339664 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.339958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.340267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.341051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.343905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.370287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1390/2790] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:46 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:46.376064 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.388226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f405a-f969-4731-aa71-18e8844664e8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.394644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.395313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.395596 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.395869 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.396644 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.398285 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.410196 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1401/2791] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:46.415011 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.431065 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d3c6f-6169-4f1d-b39d-367d7e7844a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.437241 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.438141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.438449 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.438697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] PATH_INFO: `/v3/projects/055d4dcf909149bb951a3a37dabdc1b9/users/3ac9e15741594341b4042e0e9210e452/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.456634 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=055d4dcf909149bb951a3a37dabdc1b9, user_id=3ac9e15741594341b4042e0e9210e452, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.459378 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.476027 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1391/2792] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:46 2022] PUT /identity/v3/projects/055d4dcf909149bb951a3a37dabdc1b9/users/3ac9e15741594341b4042e0e9210e452/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:46.480148 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.490562 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19ed1f-2886-48a4-9ac3-c89de283bcf4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.520981 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:46.554177 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.554891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.555166 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.555435 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.556175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.557777 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97107b3-8ad9-4ad4-bc1d-eed07b741156 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.568590 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1402/2793] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:46.574390 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.592384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a0c2-4718-47b7-8362-fa3f486af7ea admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.599980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.601081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.601367 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.601623 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] PATH_INFO: `/v3/projects/055d4dcf909149bb951a3a37dabdc1b9/users/3ac9e15741594341b4042e0e9210e452/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.603645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=055d4dcf909149bb951a3a37dabdc1b9, user_id=3ac9e15741594341b4042e0e9210e452, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.607054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.620910 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1392/2794] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:46 2022] PUT /identity/v3/projects/055d4dcf909149bb951a3a37dabdc1b9/users/3ac9e15741594341b4042e0e9210e452/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:46.631775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.632204 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.632545 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.662861 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] MFA Rules not processed for user `3ac9e15741594341b4042e0e9210e452`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:46.664167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:46.738039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1403/2795] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:46.755751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:46.758803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:46.821314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613d6b-1e97-49d1-85e3-e3f4cec0d45a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:46.825770 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:46.826413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:46.826689 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:46.826943 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:46.837272 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:46.838707 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77539-042c-4916-9d96-0de57dd46265 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:46.848520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1393/2796] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:47.268599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:47.338447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5c17b-789e-400e-94d6-748e69d71dd2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:47.343473 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:47.344393 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:47.344675 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:47.344951 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] PATH_INFO: `/v3/users/d9d277f6d8bc4ff58e23165cdbc20a09` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:47.346172 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d277f6d8bc4ff58e23165cdbc20a09)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:47.348742 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:47.410009 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d277f6d8bc4ff58e23165cdbc20a09'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:47.415490 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:47.417890 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d277f6d8bc4ff58e23165cdbc20a09'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:47.431428 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d277f6d8bc4ff58e23165cdbc20a09'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:47.432183 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d277f6d8bc4ff58e23165cdbc20a09'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:47.441589 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d277f6d8bc4ff58e23165cdbc20a09'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:47.448485 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1404/2797] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:47 2022] DELETE /identity/v3/users/d9d277f6d8bc4ff58e23165cdbc20a09 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:47.453599 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:47.453891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:47.454166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:47.473992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:47.475209 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:47.552339 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1394/2798] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:47.563498 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:47.565338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:47.625946 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902c12-f1ac-4c1a-b750-1e1108b78708 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:47.630647 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:47.631626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:47.631911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:47.632221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:47.642396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:47.644147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:47.653939 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1405/2799] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:47.954906 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:47.956408 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:47.969415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21804-5149-4c5c-bfd4-ee082d4c95ab None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:47.975352 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:47.976576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:47.976857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:47.977273 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] PATH_INFO: `/v3/projects/d7a1d09103564b64a97b9e1b3f5f151d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:47.978661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a1d09103564b64a97b9e1b3f5f151d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:47.980649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:47.982474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:48.031762 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a1d09103564b64a97b9e1b3f5f151d', 'request_id': 'req-d5c5df82-da64-4096-8c8c-a931a01831cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.038165 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a1d09103564b64a97b9e1b3f5f151d', 'request_id': 'req-d5c5df82-da64-4096-8c8c-a931a01831cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.044292 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a1d09103564b64a97b9e1b3f5f151d', 'request_id': 'req-d5c5df82-da64-4096-8c8c-a931a01831cd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.058651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] The token cache is being invalidate because project d7a1d09103564b64a97b9e1b3f5f151d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:48.058937 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.059540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.061618 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1395/2800] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:47 2022] DELETE /identity/v3/projects/d7a1d09103564b64a97b9e1b3f5f151d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:48.066385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:48.076447 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2bd94-7516-40c1-b215-83ec48819b02 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:48.136338 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:48.137258 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.137539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.137807 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] PATH_INFO: `/v3/users/3ac9e15741594341b4042e0e9210e452` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.139051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac9e15741594341b4042e0e9210e452)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:48.141027 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:48.192474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac9e15741594341b4042e0e9210e452'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.199634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac9e15741594341b4042e0e9210e452'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.212852 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac9e15741594341b4042e0e9210e452'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.213529 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac9e15741594341b4042e0e9210e452'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.216164 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:48.225694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6a2d7bab-655e-4c67-b66f-a6494908e85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac9e15741594341b4042e0e9210e452'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.235706 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1406/2801] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:48 2022] DELETE /identity/v3/users/3ac9e15741594341b4042e0e9210e452 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:48.546138 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:48.548952 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:48.562286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5df82-da64-4096-8c8c-a931a01831cd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:48.622928 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:48.623736 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.624044 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.624321 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] PATH_INFO: `/v3/projects/055d4dcf909149bb951a3a37dabdc1b9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.625751 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055d4dcf909149bb951a3a37dabdc1b9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:48.628916 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:48.687723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055d4dcf909149bb951a3a37dabdc1b9', 'request_id': 'req-3e0abf46-18df-47cb-85d4-4daff2fe4729'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.694692 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055d4dcf909149bb951a3a37dabdc1b9', 'request_id': 'req-3e0abf46-18df-47cb-85d4-4daff2fe4729'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.702066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055d4dcf909149bb951a3a37dabdc1b9', 'request_id': 'req-3e0abf46-18df-47cb-85d4-4daff2fe4729'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.718176 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] The token cache is being invalidate because project 055d4dcf909149bb951a3a37dabdc1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:48.718450 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.719096 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3e0abf46-18df-47cb-85d4-4daff2fe4729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:48.720723 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1396/2802] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:48 2022] DELETE /identity/v3/projects/055d4dcf909149bb951a3a37dabdc1b9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:48.727312 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.727818 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.727935 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.749451 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:48.750658 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:48.811976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1407/2803] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:48.885148 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.885388 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.885604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.905298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:48.906493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:48.914734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1397/2804] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:48.919154 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:48.930887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0098695-1039-4534-9a93-e4f1c3e94247 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:48.935844 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:48.936537 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.936815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.937085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.937808 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:16:48.938110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:48.939712 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:48.953502 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1408/2805] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:16:48.958245 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:48.968484 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20917-e860-4f66-a6fd-1ba46c5ce008 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:48.974697 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:48.975353 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:48.975632 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:48.975898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:48.976645 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:48.978509 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:48.990286 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:49.016955 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1398/2806] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:48 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:49.021611 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.032352 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd8453-e64f-4445-8582-286375c0e47c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.095975 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.096696 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.096961 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.097348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.098029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.099955 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.121932 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1409/2807] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:49 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:49.126264 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.137532 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce414f4b-5960-46d5-b7af-24271fbc63d3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.143757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.144504 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.144785 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.145064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.145800 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.147555 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.163033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1399/2808] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:49.167195 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.178263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d36ea-4238-4a4d-936d-86f0c0670bca admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.183055 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.183722 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.184017 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.184366 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.185090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.186670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fba90-498e-4c09-b0db-5a6f654dd597 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.197160 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1410/2809] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:49.201660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.212591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef10ff-9d84-4fdc-8aee-d16e7e9285b4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.217598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.218476 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.218760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.219026 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] PATH_INFO: `/v3/projects/5831ad03ff4542bc82e13406f655db70/users/68d1306b51c943938d3ecdf05acad877/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.234601 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5831ad03ff4542bc82e13406f655db70, user_id=68d1306b51c943938d3ecdf05acad877, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.237275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.255879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1400/2810] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:49 2022] PUT /identity/v3/projects/5831ad03ff4542bc82e13406f655db70/users/68d1306b51c943938d3ecdf05acad877/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:49.265996 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.266283 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.266583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.293491 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] MFA Rules not processed for user `68d1306b51c943938d3ecdf05acad877`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:49.294701 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:49.353426 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:49.373563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1411/2811] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:49.380323 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.461715 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694157-5b56-4fa8-82fe-87ff78969a63 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.467089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.467750 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.468051 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.468334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.469137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.470949 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.499876 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1401/2812] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:49 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:49.504900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.521226 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c055-db47-4b16-bf88-b8287affd1c6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.585327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.586022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.586320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.586619 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.587320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.589291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.613074 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1412/2813] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:49 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:16:49.617195 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.627668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77134f-c103-4fde-aef2-89e4c50926b9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.633232 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.633891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.634166 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.634433 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.635154 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.636801 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.647807 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1402/2814] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:49.652263 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.663522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f942-a0c8-4cb9-9e57-6ebfebb59728 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.668450 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.669375 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.669660 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.669934 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] PATH_INFO: `/v3/projects/666b1c11351e484284051f76dc5b4320/users/5ef7d59d0ded46569a43c54fd994703a/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.688329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666b1c11351e484284051f76dc5b4320, user_id=5ef7d59d0ded46569a43c54fd994703a, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.691147 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.710714 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1413/2815] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:49 2022] PUT /identity/v3/projects/666b1c11351e484284051f76dc5b4320/users/5ef7d59d0ded46569a43c54fd994703a/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:49.715068 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.725607 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2df9a-1098-4d6f-98dc-27eee40bcd1e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.783970 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.784708 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.784980 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.785254 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.785994 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.787581 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707372b-c2aa-42a1-bc32-071874fdcbb4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.799576 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1403/2816] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:49.804023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.814684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee012-ac67-4480-8b66-0df05151cd04 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:49.819837 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:49.820775 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.821062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.821337 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] PATH_INFO: `/v3/projects/666b1c11351e484284051f76dc5b4320/users/5ef7d59d0ded46569a43c54fd994703a/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.823544 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=666b1c11351e484284051f76dc5b4320, user_id=5ef7d59d0ded46569a43c54fd994703a, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:49.826194 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:49.838615 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1414/2817] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:49 2022] PUT /identity/v3/projects/666b1c11351e484284051f76dc5b4320/users/5ef7d59d0ded46569a43c54fd994703a/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:49.849682 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:49.850146 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:49.850593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:49.881795 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] MFA Rules not processed for user `5ef7d59d0ded46569a43c54fd994703a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:49.883066 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:49.897016 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:49.964108 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1404/2818] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:49.975976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:49.977923 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:50.042051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5af2-71b4-43e0-a6b4-dec1ee3ac1fb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:50.046274 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:50.046933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:50.047233 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:50.047489 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:50.058049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:50.059484 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72bc0b-e899-4c20-adfe-ea8b92d36477 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:50.069492 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1415/2819] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:50.474757 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:50.538087 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4db87a-d320-4a64-ad42-884933544586 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:50.543309 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:50.544374 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:50.544551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:50.544824 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] PATH_INFO: `/v3/users/68d1306b51c943938d3ecdf05acad877` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:50.546093 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d1306b51c943938d3ecdf05acad877)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:50.548049 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:50.605508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d1306b51c943938d3ecdf05acad877'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:50.618117 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d1306b51c943938d3ecdf05acad877'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:50.627280 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d1306b51c943938d3ecdf05acad877'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:50.634900 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d1306b51c943938d3ecdf05acad877'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:50.635651 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d1306b51c943938d3ecdf05acad877'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:50.641992 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1405/2820] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:50 2022] DELETE /identity/v3/users/68d1306b51c943938d3ecdf05acad877 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:50.647291 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:50.647575 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:50.647846 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:50.665949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:50.667156 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:50.708507 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:50.731763 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1416/2821] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:16:50.741610 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:50.743071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:50.780275 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:50.809510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14610f-182b-44de-89a9-96ee01b22d53 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:50.816255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:50.817190 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:50.817470 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:50.817744 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:50.828533 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:50.830020 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:50.840060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1406/2822] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:51.131329 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:51.132891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:51.148248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041193-cc90-4eff-bcc0-de8a438b4b0d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:51.153691 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:51.155342 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:51.155963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:51.156418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] PATH_INFO: `/v3/projects/5831ad03ff4542bc82e13406f655db70` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:51.157650 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5831ad03ff4542bc82e13406f655db70)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:51.159813 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:51.217875 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5831ad03ff4542bc82e13406f655db70', 'request_id': 'req-787f0220-2bb4-4497-bc1d-0f177d7a6145'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.223563 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5831ad03ff4542bc82e13406f655db70', 'request_id': 'req-787f0220-2bb4-4497-bc1d-0f177d7a6145'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.229749 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5831ad03ff4542bc82e13406f655db70', 'request_id': 'req-787f0220-2bb4-4497-bc1d-0f177d7a6145'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.243928 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] The token cache is being invalidate because project 5831ad03ff4542bc82e13406f655db70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:51.244159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.244810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.246385 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1417/2823] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:51 2022] DELETE /identity/v3/projects/5831ad03ff4542bc82e13406f655db70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:16:51.250507 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:51.260702 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6050d73-b4e6-445f-a835-20a84a2e186b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:51.320633 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:51.321520 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:51.321820 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:51.322086 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] PATH_INFO: `/v3/users/5ef7d59d0ded46569a43c54fd994703a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:51.323300 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef7d59d0ded46569a43c54fd994703a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:51.325249 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:51.382885 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef7d59d0ded46569a43c54fd994703a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.394541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef7d59d0ded46569a43c54fd994703a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.403005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef7d59d0ded46569a43c54fd994703a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.410268 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef7d59d0ded46569a43c54fd994703a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.411267 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-19278154-f529-4820-ba12-67fc41aeb33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef7d59d0ded46569a43c54fd994703a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.417401 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1407/2824] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:51 2022] DELETE /identity/v3/users/5ef7d59d0ded46569a43c54fd994703a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:51.711568 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:51.713146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:51.726605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f0220-2bb4-4497-bc1d-0f177d7a6145 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:51.790186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:51.791069 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:51.791346 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:51.791617 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] PATH_INFO: `/v3/projects/666b1c11351e484284051f76dc5b4320` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:51.793272 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=666b1c11351e484284051f76dc5b4320)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:51.795182 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:51.849051 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666b1c11351e484284051f76dc5b4320', 'request_id': 'req-f7735473-9d83-4ff9-9415-6bea41766b7b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.855522 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666b1c11351e484284051f76dc5b4320', 'request_id': 'req-f7735473-9d83-4ff9-9415-6bea41766b7b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.864642 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666b1c11351e484284051f76dc5b4320', 'request_id': 'req-f7735473-9d83-4ff9-9415-6bea41766b7b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.876193 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:51.882513 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] The token cache is being invalidate because project 666b1c11351e484284051f76dc5b4320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:16:51.883124 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.884225 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f7735473-9d83-4ff9-9415-6bea41766b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:16:51.886078 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1418/2825] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:16:51 2022] DELETE /identity/v3/projects/666b1c11351e484284051f76dc5b4320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:51.891089 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:51.891377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:51.891673 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:51.945748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:51.946983 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:51.976113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:52.017214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1408/2826] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:52.025313 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03812909-91a0-486e-bf07-680692865cdc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.025605 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03812909-91a0-486e-bf07-680692865cdc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.025876 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03812909-91a0-486e-bf07-680692865cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.048628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-03812909-91a0-486e-bf07-680692865cdc None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:52.048628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-03812909-91a0-486e-bf07-680692865cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:52.058367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1419/2827] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:52.065174 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.076034 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5e434-cf98-4bb8-ad54-b96799d6a2ba None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.082288 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.083072 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.083347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.083612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.084377 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:16:52.084675 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.086291 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.098727 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1409/2828] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:16:52.103683 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03812909-91a0-486e-bf07-680692865cdc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.118797 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03812909-91a0-486e-bf07-680692865cdc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.127868 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.128847 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.129146 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.129705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.130423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.132367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.163853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1420/2829] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:16:52.168964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.179845 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8cbf-64c8-4964-9c76-d5d2d082199d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.241591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.242262 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.242548 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.242822 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.243512 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.245469 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.268458 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1410/2830] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:52.273115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.283759 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616255-4ecd-492a-8662-0cdfbfb56c00 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.288685 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.289331 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.289613 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.289887 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.290622 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.292275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.302884 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1421/2831] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:52.307710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.318775 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d2f67-629a-469d-a4cc-2cbffac50b7b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.324247 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.324911 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.325201 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.325481 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.326211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.328223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5a6eb-f032-440e-be56-e1f534369368 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.340018 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1411/2832] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:52.344662 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.355223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5bb5e-b12c-4c70-ac2a-cfc4e5ac0c3a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.360425 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.361304 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.361584 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.361879 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] PATH_INFO: `/v3/projects/4ab9dd861e194d16995edac4b23a05b3/users/375bf73b1e30407eac95573a6bb65fb7/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.378445 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab9dd861e194d16995edac4b23a05b3, user_id=375bf73b1e30407eac95573a6bb65fb7, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.381245 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.398095 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1422/2833] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:52 2022] PUT /identity/v3/projects/4ab9dd861e194d16995edac4b23a05b3/users/375bf73b1e30407eac95573a6bb65fb7/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:52.408742 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.409059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.409356 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.438463 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] MFA Rules not processed for user `375bf73b1e30407eac95573a6bb65fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:52.439678 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:52.516054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1412/2834] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:52.521050 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.588519 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3eb83-33bd-412d-b981-600e22259996 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.593915 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.594567 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.594849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.595123 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.595817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.597760 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.631344 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1423/2835] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:52.637541 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.652857 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa43eb-4627-4987-a134-2b674aad62a3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.676472 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:52.717781 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.718466 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.718748 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.719024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.719717 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.721667 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.743768 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1413/2836] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:52.749235 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.765372 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134bfe3-2426-41b8-a212-7637af7cb794 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.771853 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.772599 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.772835 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.773107 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.773892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.775610 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.788913 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1424/2837] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:52.793215 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.809396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d965-43ca-4751-8189-8147493aa9b3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.814895 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.815573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.815852 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.816160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.816897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.818931 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5e71a-6d32-45f1-a391-d047e09084b0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.830000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1414/2838] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 21:16:52.835470 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:52.850161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346e70-6efb-45cc-a2df-64d4b592a641 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:52.855317 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:52.856223 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.856517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.856793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] PATH_INFO: `/v3/projects/4b89ee5f7292473797bce686f173fdbe/users/6d7ed5bc12364e82a631707f577b30c9/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.872708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b89ee5f7292473797bce686f173fdbe, user_id=6d7ed5bc12364e82a631707f577b30c9, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:52.875339 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:52.891452 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1425/2839] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:52 2022] PUT /identity/v3/projects/4b89ee5f7292473797bce686f173fdbe/users/6d7ed5bc12364e82a631707f577b30c9/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:52.913987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:52.914383 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:52.914726 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:52.953258 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] MFA Rules not processed for user `6d7ed5bc12364e82a631707f577b30c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:52.954491 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:53.021883 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1415/2840] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:53.028769 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.078711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:53.097133 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17eb1-cb78-4795-85b0-2aba5a1139d5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.102336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.102882 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.103159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.103429 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.104140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.106048 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.133843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1426/2841] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:16:53 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:53.138160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.150503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4708-d998-46ca-ab46-cd854f8e7f5d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.219031 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.219710 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.220022 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.220298 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.220997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.222913 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.245586 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1416/2842] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:16:53 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:16:53.249871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.260588 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1d30d-8dad-4c14-9ca5-25d8e23eaf35 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.265988 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.267140 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.267692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.268178 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.269403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.272053 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.283387 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1427/2843] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:53.287854 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.298194 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa138d1-81dc-402e-a17b-2598e76678e6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.303325 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.304728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.304728 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.305071 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] PATH_INFO: `/v3/projects/2a423a7565044cebb90134cc4871e6c7/users/e9eaa7240e1b46e8a715580f7e9d4e8f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.319732 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a423a7565044cebb90134cc4871e6c7, user_id=e9eaa7240e1b46e8a715580f7e9d4e8f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.322397 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.333413 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:53.339474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1417/2844] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:53 2022] PUT /identity/v3/projects/2a423a7565044cebb90134cc4871e6c7/users/e9eaa7240e1b46e8a715580f7e9d4e8f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:53.343626 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.359892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50d39-4aae-456d-a87d-d872dc5f9aa2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.432121 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.432820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.433105 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.433357 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.434115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.435737 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45df84-13e3-4c3e-bd6c-3850c33e3580 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.447535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1428/2845] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:16:53.452840 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.466578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbf6d-d4a4-4e4d-8c3e-2d04c5dd37d1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.472514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.473415 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.473694 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.473964 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] PATH_INFO: `/v3/projects/2a423a7565044cebb90134cc4871e6c7/users/e9eaa7240e1b46e8a715580f7e9d4e8f/roles/752ec01362414518a74fb7fe863f812e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.476230 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a423a7565044cebb90134cc4871e6c7, user_id=e9eaa7240e1b46e8a715580f7e9d4e8f, role_id=752ec01362414518a74fb7fe863f812e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.478868 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.489893 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1418/2846] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:16:53 2022] PUT /identity/v3/projects/2a423a7565044cebb90134cc4871e6c7/users/e9eaa7240e1b46e8a715580f7e9d4e8f/roles/752ec01362414518a74fb7fe863f812e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:16:53.500542 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.501157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.501157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.531157 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] MFA Rules not processed for user `e9eaa7240e1b46e8a715580f7e9d4e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:16:53.532396 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:53.610784 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1429/2847] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:16:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:16:53.623437 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:53.625269 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:53.686649 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c19c-2948-483d-a12e-db42e85f96b8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:53.691287 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:53.691944 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:53.692250 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:53.692525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:53.754761 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:53.756384 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:53.766347 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1419/2848] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:55.283713 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:55.285270 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:16:55.298200 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4d8b3-742a-4970-b939-c4843368828d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:55.301817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:55.302405 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:55.302684 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:55.302960 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:55.343475 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:55.366219 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:55.367682 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:55.377181 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1430/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:55.959564 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:55.968779 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11b50-f901-4026-9d2e-60057be9d91e service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:55.973730 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:16:55.974376 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:16:55.974656 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:16:55.975270 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:16:55.989434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:16:55.991455 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e922f06-9523-4466-b660-28a9285c3bcd service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:16:56.006411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1420/2850] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:16:59.926418 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:16:59.994302 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f49d-95c4-44cf-bcb1-7f4af339c740 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:16:59.999719 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:00.000652 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:00.001029 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:00.001306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] PATH_INFO: `/v3/users/375bf73b1e30407eac95573a6bb65fb7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:00.002518 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375bf73b1e30407eac95573a6bb65fb7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:00.004486 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:00.057750 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375bf73b1e30407eac95573a6bb65fb7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.066336 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375bf73b1e30407eac95573a6bb65fb7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.080829 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375bf73b1e30407eac95573a6bb65fb7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.081530 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375bf73b1e30407eac95573a6bb65fb7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.093254 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375bf73b1e30407eac95573a6bb65fb7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.099601 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1431/2851] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:16:59 2022] DELETE /identity/v3/users/375bf73b1e30407eac95573a6bb65fb7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:00.104432 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:00.104938 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:00.105036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:00.122622 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:00.123789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:00.194834 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1421/2852] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 21:17:00.207855 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:00.209952 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:00.274187 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168e56-cc2f-4b71-93b3-9a0d381800f3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:00.278000 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:00.278655 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:00.278933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:00.279206 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:00.288738 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:00.290176 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:00.295097 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:00.300460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1432/2853] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:00.605873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:00.607495 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:00.620580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b3d1-e8e2-4400-8a59-93cd2fbd2bf2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:00.625701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:00.626661 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:00.627006 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:00.627355 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] PATH_INFO: `/v3/projects/4ab9dd861e194d16995edac4b23a05b3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:00.628643 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab9dd861e194d16995edac4b23a05b3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:00.630580 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:00.800139 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:00.829990 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab9dd861e194d16995edac4b23a05b3', 'request_id': 'req-d4cdd2bc-b244-4f16-864d-0ff370d748a9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.838314 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab9dd861e194d16995edac4b23a05b3', 'request_id': 'req-d4cdd2bc-b244-4f16-864d-0ff370d748a9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.844505 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab9dd861e194d16995edac4b23a05b3', 'request_id': 'req-d4cdd2bc-b244-4f16-864d-0ff370d748a9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.863948 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] The token cache is being invalidate because project 4ab9dd861e194d16995edac4b23a05b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:17:00.864445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.865414 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:00.867793 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1422/2854] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:17:00 2022] DELETE /identity/v3/projects/4ab9dd861e194d16995edac4b23a05b3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:00.873309 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:00.883628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df3bec-227d-4369-95ac-3d3ddf09a613 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:00.945515 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:00.946395 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:00.946674 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:00.946947 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] PATH_INFO: `/v3/users/6d7ed5bc12364e82a631707f577b30c9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:00.948248 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7ed5bc12364e82a631707f577b30c9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:00.950167 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:01.015461 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7ed5bc12364e82a631707f577b30c9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.022535 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7ed5bc12364e82a631707f577b30c9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.035144 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7ed5bc12364e82a631707f577b30c9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.035891 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7ed5bc12364e82a631707f577b30c9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.045911 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7ed5bc12364e82a631707f577b30c9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.052275 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1433/2855] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:17:00 2022] DELETE /identity/v3/users/6d7ed5bc12364e82a631707f577b30c9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:01.337594 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:01.339106 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:01.354575 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdd2bc-b244-4f16-864d-0ff370d748a9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:01.422299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:01.423185 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:01.423441 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:01.423701 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] PATH_INFO: `/v3/projects/4b89ee5f7292473797bce686f173fdbe` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:01.425061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b89ee5f7292473797bce686f173fdbe)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:01.426945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:01.478310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b89ee5f7292473797bce686f173fdbe', 'request_id': 'req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.485665 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b89ee5f7292473797bce686f173fdbe', 'request_id': 'req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.492184 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b89ee5f7292473797bce686f173fdbe', 'request_id': 'req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.511005 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] The token cache is being invalidate because project 4b89ee5f7292473797bce686f173fdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:17:01.511410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.512429 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.514771 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1423/2856] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:17:01 2022] DELETE /identity/v3/projects/4b89ee5f7292473797bce686f173fdbe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:17:01.520620 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:01.522540 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:01.536496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5c35-9768-4300-becd-8e7dd92cb298 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:01.600618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:01.601495 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:01.601877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:01.602179 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] PATH_INFO: `/v3/users/e9eaa7240e1b46e8a715580f7e9d4e8f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:01.603457 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9eaa7240e1b46e8a715580f7e9d4e8f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:01.605420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:01.628120 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:01.656325 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9eaa7240e1b46e8a715580f7e9d4e8f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.663117 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9eaa7240e1b46e8a715580f7e9d4e8f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.674933 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9eaa7240e1b46e8a715580f7e9d4e8f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.675628 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9eaa7240e1b46e8a715580f7e9d4e8f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.685833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-689429bc-e8d2-4044-8c06-2709722cb383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9eaa7240e1b46e8a715580f7e9d4e8f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:01.695692 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1434/2857] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:17:01 2022] DELETE /identity/v3/users/e9eaa7240e1b46e8a715580f7e9d4e8f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:02.015658 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.017164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:02.029993 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1de3-1c36-4387-84c0-ca88dd46c1a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.070550 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:02.091861 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.092839 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.093123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.093396 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] PATH_INFO: `/v3/projects/2a423a7565044cebb90134cc4871e6c7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.094593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a423a7565044cebb90134cc4871e6c7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.096515 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.147333 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a423a7565044cebb90134cc4871e6c7', 'request_id': 'req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:02.153889 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a423a7565044cebb90134cc4871e6c7', 'request_id': 'req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:02.159946 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a423a7565044cebb90134cc4871e6c7', 'request_id': 'req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:02.177041 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] The token cache is being invalidate because project 2a423a7565044cebb90134cc4871e6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:17:02.177420 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:02.178346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1fd01ff7-4e6f-4b01-bcbe-5690c4ee4c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:02.180214 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1424/2858] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:17:02 2022] DELETE /identity/v3/projects/2a423a7565044cebb90134cc4871e6c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 21:17:02.185877 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.186403 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.186504 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.205710 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:02.206920 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:02.276033 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1435/2859] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:02.284782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.285164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.285540 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.312739 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:02.313959 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:02.322988 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1425/2860] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:02.329143 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.342506 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25e557-30b6-47f1-9643-5f91b272f5cf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.348011 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.348694 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.348995 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.349265 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.350049 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:17:02.350398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.351982 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.366082 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1436/2861] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 21:17:02.370853 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.381014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c8266-12c8-4cc1-aba3-657d1025f774 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.386503 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.387160 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.387460 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.387743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.388483 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.390373 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.420361 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1426/2862] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:17:02.424739 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.435474 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33bb1-7559-486d-b826-9be648f5ce31 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.492561 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.493249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.493538 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.493843 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.494625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.496577 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.518944 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1437/2863] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:17:02 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:17:02.523411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.534123 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b0fb7-f055-4266-84bd-feaae5685798 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.539081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.539746 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.540061 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.540340 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.541217 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.542830 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.553780 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1427/2864] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:17:02.559922 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.571539 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be206c5a-2ec6-4005-ac61-fbe2b2d64cf1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.578400 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.579081 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.579369 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.579634 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.580406 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.582039 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd52866-e493-4641-9233-325272b08fed admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.594659 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1438/2865] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:17:02.599259 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.610318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ef85-a05e-40a5-bcda-f820c818f633 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.615787 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.616716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.616997 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.617271 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] PATH_INFO: `/v3/projects/2d7f53e27a1e4c66a625dd8c9d000032/users/d9daec1ee9b448279b7753bf7737d345/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.632973 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7f53e27a1e4c66a625dd8c9d000032, user_id=d9daec1ee9b448279b7753bf7737d345, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.636366 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.652434 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1428/2866] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:17:02 2022] PUT /identity/v3/projects/2d7f53e27a1e4c66a625dd8c9d000032/users/d9daec1ee9b448279b7753bf7737d345/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:02.664705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.665066 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.665398 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.673256 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:02.695215 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] MFA Rules not processed for user `d9daec1ee9b448279b7753bf7737d345`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:02.696460 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:02.769224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1439/2867] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:02.780573 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:02.782518 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:02.844159 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2027d-4cc9-4243-b86e-a933f57cc0a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:02.848411 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:02.849064 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:02.849346 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:02.849604 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:02.858304 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:02.859743 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468174-de45-4d27-b87b-fd5b86776895 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:02.869014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1429/2868] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:12.766224 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=30 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:12.864782 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:13.002833 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:13.082765 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14ea9-073e-4033-9356-7dc0f32ac85e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:13.088919 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:13.089810 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.090090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.090367 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] PATH_INFO: `/v3/users/d9daec1ee9b448279b7753bf7737d345` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.091624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9daec1ee9b448279b7753bf7737d345)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:13.093582 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:13.147454 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9daec1ee9b448279b7753bf7737d345'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.154770 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9daec1ee9b448279b7753bf7737d345'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.168420 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9daec1ee9b448279b7753bf7737d345'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.169436 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9daec1ee9b448279b7753bf7737d345'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.182128 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9daec1ee9b448279b7753bf7737d345'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.188221 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1440/2869] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:17:13 2022] DELETE /identity/v3/users/d9daec1ee9b448279b7753bf7737d345 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:13.194023 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.194459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.194760 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.216310 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:13.217523 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:13.284147 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1430/2870] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:13.297794 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:13.300892 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:13.366115 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0074d2-697a-4a4b-8a65-2a5a621c5bc8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:13.369937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:13.370633 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.370854 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.371151 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.381161 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:13.382618 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf0a08-846a-4a8d-9db4-56e4b1dc1fdd service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:13.392347 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1441/2871] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:13.680354 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:13.682172 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:13.702837 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc82a3-c0eb-446d-ab55-f89f25808560 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:13.711000 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:13.713081 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.713457 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.713873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] PATH_INFO: `/v3/projects/2d7f53e27a1e4c66a625dd8c9d000032` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.715578 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7f53e27a1e4c66a625dd8c9d000032)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:13.717963 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:13.769024 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7f53e27a1e4c66a625dd8c9d000032', 'request_id': 'req-5836bc27-6b2b-4efb-a658-8d1280099087'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.776370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7f53e27a1e4c66a625dd8c9d000032', 'request_id': 'req-5836bc27-6b2b-4efb-a658-8d1280099087'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.781789 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7f53e27a1e4c66a625dd8c9d000032', 'request_id': 'req-5836bc27-6b2b-4efb-a658-8d1280099087'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.795171 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] The token cache is being invalidate because project 2d7f53e27a1e4c66a625dd8c9d000032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:17:13.795459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.796095 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5836bc27-6b2b-4efb-a658-8d1280099087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:13.797621 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1431/2872] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:17:13 2022] DELETE /identity/v3/projects/2d7f53e27a1e4c66a625dd8c9d000032 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:13.802612 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.803100 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.803209 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.821811 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:13.823008 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:13.840306 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:13.886716 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1442/2873] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:13.894593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.895113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.895113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.914987 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:13.916255 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:13.924891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1432/2874] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:13.930437 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:13.940510 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c122-9ed4-42ef-beeb-b12eb6f4492f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:13.946261 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:13.946957 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.947238 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.947511 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.948297 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 21:17:13.948583 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:13.950189 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:13.963014 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1443/2875] 10.222.0.33 () {58 vars in 1152 bytes} [Mon Jun 6 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 21:17:13.969094 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:13.979168 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ea460-777c-4582-8a02-94c165af09dd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:13.984659 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:13.985318 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:13.985598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:13.985867 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:13.986571 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:13.988538 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.017427 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1433/2876] 10.222.0.33 () {60 vars in 1152 bytes} [Mon Jun 6 21:17:13 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 21:17:14.022249 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:14.033499 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd745ce-51d1-4a0a-b85d-ac853abcdae7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:14.097162 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:14.098142 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.098480 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.099318 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.099817 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:14.102938 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.130864 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1444/2877] 10.222.0.33 () {60 vars in 1143 bytes} [Mon Jun 6 21:17:14 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 21:17:14.135360 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:14.146763 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7eb99-e92b-4780-9084-9ce2d07a936b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:14.151898 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:14.152591 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.152871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.153144 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.153879 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:14.155477 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.166905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1434/2878] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:17:14.171085 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:14.181820 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44725-c51f-41d8-a5d9-dfae9ebfa326 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:14.187090 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:14.187755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.188041 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.188327 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.189067 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:14.190670 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff496437-b81e-45c6-a453-e72cbb51aa3c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.201815 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1445/2879] 10.222.0.33 () {58 vars in 1121 bytes} [Mon Jun 6 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 21:17:14.207668 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:14.218508 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd7284-0c98-4cfb-976a-f559d8bdd795 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:14.223170 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:14.224459 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.224740 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.225014 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] PATH_INFO: `/v3/projects/f691f36fd59b408a8efb3b0a7f79d46f/users/3e81b3131fbb4c248c30ab105d857a9a/roles/4ed191822ab745e79a1e8158b3c6779b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.239593 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f691f36fd59b408a8efb3b0a7f79d46f, user_id=3e81b3131fbb4c248c30ab105d857a9a, role_id=4ed191822ab745e79a1e8158b3c6779b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:14.242551 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.258125 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1435/2880] 10.222.0.33 () {60 vars in 1482 bytes} [Mon Jun 6 21:17:14 2022] PUT /identity/v3/projects/f691f36fd59b408a8efb3b0a7f79d46f/users/3e81b3131fbb4c248c30ab105d857a9a/roles/4ed191822ab745e79a1e8158b3c6779b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:14.269423 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cfc4c-54b1-4260-b97e-b38e8230e9eb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.269708 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cfc4c-54b1-4260-b97e-b38e8230e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.270022 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cfc4c-54b1-4260-b97e-b38e8230e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.297730 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b91cfc4c-54b1-4260-b97e-b38e8230e9eb None None] MFA Rules not processed for user `3e81b3131fbb4c248c30ab105d857a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:14.298945 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b91cfc4c-54b1-4260-b97e-b38e8230e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:14.376849 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1446/2881] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:14.391079 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:14.394115 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:14.423587 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:14.462616 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975867f-cad5-4de2-a65e-7a43d991962c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:14.466488 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cf9f259e6b448eafcf246c09f0ade8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:14.467135 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:14.467410 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:14.467680 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:14.476566 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:14.477996 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:14.486871 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1436/2882] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:15.864534 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ef6d-1264-4b92-b0b2-d37d3f7681e6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:15.865093 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ef6d-1264-4b92-b0b2-d37d3f7681e6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:15.865356 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ef6d-1264-4b92-b0b2-d37d3f7681e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:15.885963 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7e06ef6d-1264-4b92-b0b2-d37d3f7681e6 None None] MFA Rules not processed for user `3e81b3131fbb4c248c30ab105d857a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:15.887186 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7e06ef6d-1264-4b92-b0b2-d37d3f7681e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:15.895364 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1447/2883] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:24.483324 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=17 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:24.849681 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:24.851221 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:24.936299 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbbf0-63df-4e11-b7e6-883dbb2f8615 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:24.941676 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4746a0f4669742ba9e03404e04ae0536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:24.942327 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:24.942611 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:24.942888 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:24.944695 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:24.957369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:24.958945 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:24.969602 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1437/2884] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:25.878886 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:30.910110 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b2aa9-488b-4c22-a8ea-3afc1d2af74e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:30.910741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b2aa9-488b-4c22-a8ea-3afc1d2af74e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:30.910741 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b2aa9-488b-4c22-a8ea-3afc1d2af74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:30.942755 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-638b2aa9-488b-4c22-a8ea-3afc1d2af74e None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:30.943976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-638b2aa9-488b-4c22-a8ea-3afc1d2af74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:31.001441 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1448/2885] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:31.050625 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:31.052059 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:31.123940 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b8291-7796-4a18-9a79-f22028416b50 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:31.129688 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:31.130337 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:31.130612 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:31.130880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:31.140951 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:31.142786 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:31.153213 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1438/2886] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:17:31.726624 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634158-6272-457f-866c-0865c40ac1c5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:31.726953 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634158-6272-457f-866c-0865c40ac1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:31.727281 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634158-6272-457f-866c-0865c40ac1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:31.750663 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e4634158-6272-457f-866c-0865c40ac1c5 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:31.751871 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e4634158-6272-457f-866c-0865c40ac1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:31.762466 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1449/2887] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:31.777334 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:31.789113 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f13c-db29-420c-a052-9aced1bb1cb5 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:31.796391 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:31.797091 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:31.797370 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:31.797639 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:31.808211 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:31.809819 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:31.818731 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1439/2888] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 06 21:17:32.042165 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564db11-c23a-47a7-80c6-fcca4a55860e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:32.042711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564db11-c23a-47a7-80c6-fcca4a55860e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:32.042711 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564db11-c23a-47a7-80c6-fcca4a55860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:32.062434 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2564db11-c23a-47a7-80c6-fcca4a55860e None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:32.063643 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2564db11-c23a-47a7-80c6-fcca4a55860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:32.072112 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1450/2889] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Jun 6 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:32.085060 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:32.096265 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e000f8-3597-42b0-826f-752f0b84a9f8 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:32.102223 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:32.102873 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:32.103164 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:32.103431 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:32.112369 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:32.113958 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:32.122379 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1440/2890] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:17:32.472349 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:32.472637 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:32.472910 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:32.490937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] MFA Rules not processed for user `52c2cce5fd744ac9a278955e1ae3bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:32.492159 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:32.500023 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1451/2891] 10.222.0.33 () {58 vars in 967 bytes} [Mon Jun 6 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:32.512493 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:32.523635 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86143c-a406-48a8-b64d-9bd23444dc48 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:32.530514 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7356175da142a8a4a30b9476303b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:32.531158 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:32.531445 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:32.531716 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:32.540510 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:32.542436 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48851f6-c79d-4eba-be16-93c58bda0f2f service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:32.550803 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1441/2892] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Jun 6 21:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 21:17:34.906175 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:34.990389 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9354-081c-4570-87d8-90891a5b6e24 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:34.995431 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:34.996348 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:34.996625 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:34.996900 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] PATH_INFO: `/v3/users/3e81b3131fbb4c248c30ab105d857a9a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:34.998130 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e81b3131fbb4c248c30ab105d857a9a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:35.000086 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:35.049096 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e81b3131fbb4c248c30ab105d857a9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.055976 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e81b3131fbb4c248c30ab105d857a9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.069260 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e81b3131fbb4c248c30ab105d857a9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.069969 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e81b3131fbb4c248c30ab105d857a9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.073705 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:35.080569 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e81b3131fbb4c248c30ab105d857a9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.087320 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1452/2893] 10.222.0.33 () {58 vars in 1223 bytes} [Mon Jun 6 21:17:34 2022] DELETE /identity/v3/users/3e81b3131fbb4c248c30ab105d857a9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:35.092141 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:35.092644 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:35.092759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:35.111417 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] MFA Rules not processed for user `d45573389f8249aaa5d35d830a5a6625`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 21:17:35.112654 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:35.143897 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:35.182660 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1442/2894] 10.222.0.33 () {58 vars in 957 bytes} [Mon Jun 6 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 21:17:35.192830 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:35.194937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:35.275034 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f176c-d4cf-4476-b18d-ab5caf00f177 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:35.279927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a77e82299a2d4e679032867478dc7247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:35.280653 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:35.280927 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:35.281197 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:35.291656 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:35.293496 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:35.303113 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1453/2895] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:35.493598 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:35.495440 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:35.510721 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3cfcd-b84c-42a2-a09b-8823bc544fb9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:35.516442 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd45573389f8249aaa5d35d830a5a6625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975471a492db48b49b1c3d1741da2fcb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:35.519137 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:35.519424 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:35.519769 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] PATH_INFO: `/v3/projects/f691f36fd59b408a8efb3b0a7f79d46f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:35.521033 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f691f36fd59b408a8efb3b0a7f79d46f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:35.523036 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:35.581891 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f691f36fd59b408a8efb3b0a7f79d46f', 'request_id': 'req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.589078 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f691f36fd59b408a8efb3b0a7f79d46f', 'request_id': 'req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.594880 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f691f36fd59b408a8efb3b0a7f79d46f', 'request_id': 'req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.609474 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] The token cache is being invalidate because project f691f36fd59b408a8efb3b0a7f79d46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 21:17:35.609759 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.610362 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 21:17:35.611905 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1443/2896] 10.222.0.33 () {58 vars in 1232 bytes} [Mon Jun 6 21:17:35 2022] DELETE /identity/v3/projects/f691f36fd59b408a8efb3b0a7f79d46f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 21:17:40.746310 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:17:40.747937 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:40.844062 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed050563-cf6c-416e-b986-246b797e754c service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:17:40.916740 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:17:40.917394 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:17:40.917680 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:17:40.917949 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:17:40.920688 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:17:40.934857 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:17:40.936517 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139feb8-2a1b-4731-bf02-c22c505c7ed8 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:17:40.946912 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1454/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:17:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:17:45.606741 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:50.942793 dv-cinder-844880-1-iscsi devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:22:45.708693 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 21:22:45.710359 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 21:22:45.726806 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facac4f-e6fe-4edc-a403-56ff2fbf0e7f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 21:22:45.732882 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b00832e92241ee803efdb173c94f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c12f66034e6944f58cd1e70ce1ce0296', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 21:22:45.733525 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 21:22:45.733798 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 21:22:45.734054 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 21:22:45.744734 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 21:22:45.746320 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734edc7a-32e9-4fd0-a86b-d2d18f68f65a service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 21:22:45.756766 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1444/2898] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Jun 6 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 21:22:55.752409 dv-cinder-844880-1-iscsi devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}